2023-11-24T06:01:21.657 INFO:root:teuthology version: 0.0.1.dev205+g2442239 2023-11-24T06:01:21.658 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} --verbose --archive /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553 --owner scheduled_rishabh@teuthology --name rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi -- /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/orig.config.yaml 2023-11-24T06:01:21.706 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:01:21.795 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553 branch: rishabh-mgr-vol-misc description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} email: null first_in_suite: false job_id: '7465553' kernel: client: sha1: distro flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-mgr-vol-misc ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-mgr-vol-misc sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3305 sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c sleep_before_teardown: 0 suite: fs:volumes suite_branch: rishabh-mgr-vol-misc suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi176.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 2442239d2653456406c25ae0c71b689c8f2657b6 timestamp: 2023-11-24_05:41:33 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-24T06:01:21.795 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa; will attempt to use it 2023-11-24T06:01:21.796 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks 2023-11-24T06:01:21.796 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-24T06:01:21.797 INFO:teuthology.task.internal:Checking packages... 2023-11-24T06:01:21.824 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a13ea5ff00cb4df7a9cc941166ddeb358881144c' 2023-11-24T06:01:21.824 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-24T06:01:21.824 INFO:teuthology.packaging:ref: None 2023-11-24T06:01:21.824 INFO:teuthology.packaging:tag: None 2023-11-24T06:01:21.824 INFO:teuthology.packaging:branch: rishabh-mgr-vol-misc 2023-11-24T06:01:21.824 INFO:teuthology.packaging:sha1: a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:01:21.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-mgr-vol-misc 2023-11-24T06:01:21.974 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7484.ga13ea5ff 2023-11-24T06:01:21.974 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-24T06:01:21.984 INFO:teuthology.task.internal:no buildpackages task found 2023-11-24T06:01:21.984 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-24T06:01:21.998 INFO:teuthology.task.internal:Saving configuration 2023-11-24T06:01:22.016 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-24T06:01:22.027 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:01:22.049 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:56:09.150531', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T06:01:22.072 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:56:09.148649', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T06:01:22.073 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-24T06:01:22.081 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-11-24T06:01:22.082 INFO:teuthology.task.internal:roles: ubuntu@smithi176.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-11-24T06:01:22.082 INFO:teuthology.run_tasks:Running task console_log... 2023-11-24T06:01:22.150 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f34f0a1db80>, signals=[15]) 2023-11-24T06:01:22.150 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-24T06:01:22.161 INFO:teuthology.task.internal:Opening connections... 2023-11-24T06:01:22.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:01:22.164 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:01:22.231 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:01:22.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:01:22.299 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-24T06:01:22.311 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2023-11-24T06:01:22.332 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2023-11-24T06:01:22.333 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2023-11-24T06:01:22.392 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Red Hat Enterprise Linux" 2023-11-24T06:01:22.392 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="8.6 (Ootpa)" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:ID="rhel" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE="fedora" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="8.6" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:PLATFORM_ID="platform:el8" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:ANSI_COLOR="0;31" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.redhat.com/" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T06:01:22.393 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:01:22.394 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-24T06:01:22.394 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-24T06:01:22.394 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-24T06:01:22.394 INFO:teuthology.orchestra.run.smithi106.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-24T06:01:22.394 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2023-11-24T06:01:22.418 DEBUG:teuthology.orchestra.run.smithi176:> uname -m 2023-11-24T06:01:22.438 INFO:teuthology.orchestra.run.smithi176.stdout:x86_64 2023-11-24T06:01:22.438 DEBUG:teuthology.orchestra.run.smithi176:> cat /etc/os-release 2023-11-24T06:01:22.498 INFO:teuthology.orchestra.run.smithi176.stdout:NAME="Red Hat Enterprise Linux" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION="8.6 (Ootpa)" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:ID="rhel" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:ID_LIKE="fedora" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:VERSION_ID="8.6" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:PLATFORM_ID="platform:el8" 2023-11-24T06:01:22.499 INFO:teuthology.orchestra.run.smithi176.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:ANSI_COLOR="0;31" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:HOME_URL="https://www.redhat.com/" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-11-24T06:01:22.500 INFO:teuthology.orchestra.run.smithi176.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-11-24T06:01:22.501 INFO:teuthology.lock.ops:Updating smithi176.front.sepia.ceph.com on lock server 2023-11-24T06:01:22.517 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-24T06:01:22.531 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-24T06:01:22.543 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-24T06:01:22.543 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2023-11-24T06:01:22.546 DEBUG:teuthology.orchestra.run.smithi176:> test '!' -e /home/ubuntu/cephtest 2023-11-24T06:01:22.564 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-24T06:01:22.575 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-24T06:01:22.575 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2023-11-24T06:01:22.605 DEBUG:teuthology.orchestra.run.smithi176:> test -z $(ls -A /var/lib/ceph) 2023-11-24T06:01:22.639 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-24T06:01:22.690 INFO:teuthology.run_tasks:Running task kernel... 2023-11-24T06:01:22.712 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-24T06:01:22.712 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-11-24T06:01:22.713 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-11-24T06:01:22.713 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T06:01:22.713 DEBUG:teuthology.orchestra.run.smithi176:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-24T06:01:22.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:22.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:22.734 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2023-11-24T06:01:22.735 DEBUG:teuthology.orchestra.run.smithi176:> uname -r 2023-11-24T06:01:22.794 INFO:teuthology.orchestra.run.smithi176.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:22.794 INFO:teuthology.task.kernel:Running kernel on smithi176: 4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:22.794 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum install -y kernel 2023-11-24T06:01:22.795 INFO:teuthology.orchestra.run.smithi106.stdout:4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:22.796 INFO:teuthology.task.kernel:Running kernel on smithi106: 4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:22.796 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum install -y kernel 2023-11-24T06:01:23.996 INFO:teuthology.orchestra.run.smithi176.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:23.996 INFO:teuthology.orchestra.run.smithi176.stdout:Unable to read consumer identity 2023-11-24T06:01:24.086 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:24.086 INFO:teuthology.orchestra.run.smithi106.stdout:Unable to read consumer identity 2023-11-24T06:01:25.517 INFO:teuthology.orchestra.run.smithi176.stdout:Copr repo for python3-asyncssh owned by ceph 14 kB/s | 3.5 kB 00:00 2023-11-24T06:01:25.562 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-11-24T06:01:26.821 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-11-24T06:01:27.059 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 10 MB/s | 16 MB 00:01 2023-11-24T06:01:30.332 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 459 kB/s | 24 kB 00:00 2023-11-24T06:01:30.568 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 446 kB/s | 24 kB 00:00 2023-11-24T06:01:31.051 INFO:teuthology.orchestra.run.smithi106.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-24T06:01:31.098 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2023-11-24T06:01:31.099 INFO:teuthology.orchestra.run.smithi106.stdout:Nothing to do. 2023-11-24T06:01:31.099 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2023-11-24T06:01:31.215 DEBUG:teuthology.orchestra.run.smithi106:> echo no | sudo yum reinstall kernel || true 2023-11-24T06:01:31.303 INFO:teuthology.orchestra.run.smithi176.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-11-24T06:01:31.343 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2023-11-24T06:01:31.344 INFO:teuthology.orchestra.run.smithi176.stdout:Nothing to do. 2023-11-24T06:01:31.344 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2023-11-24T06:01:31.464 DEBUG:teuthology.orchestra.run.smithi176:> echo no | sudo yum reinstall kernel || true 2023-11-24T06:01:31.585 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:31.585 INFO:teuthology.orchestra.run.smithi106.stdout:Unable to read consumer identity 2023-11-24T06:01:31.793 INFO:teuthology.orchestra.run.smithi176.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:31.793 INFO:teuthology.orchestra.run.smithi176.stdout:Unable to read consumer identity 2023-11-24T06:01:31.843 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:01 ago on Fri 24 Nov 2023 06:01:30 AM UTC. 2023-11-24T06:01:31.886 INFO:teuthology.orchestra.run.smithi106.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T06:01:31.940 INFO:teuthology.orchestra.run.smithi106.stderr:Error: No packages marked for reinstall. 2023-11-24T06:01:31.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum reinstall -y kernel || true 2023-11-24T06:01:32.053 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 06:01:30 AM UTC. 2023-11-24T06:01:32.108 INFO:teuthology.orchestra.run.smithi176.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T06:01:32.137 INFO:teuthology.orchestra.run.smithi176.stderr:Error: No packages marked for reinstall. 2023-11-24T06:01:32.183 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum reinstall -y kernel || true 2023-11-24T06:01:32.314 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:32.314 INFO:teuthology.orchestra.run.smithi106.stdout:Unable to read consumer identity 2023-11-24T06:01:32.510 INFO:teuthology.orchestra.run.smithi176.stdout:Updating Subscription Management repositories. 2023-11-24T06:01:32.510 INFO:teuthology.orchestra.run.smithi176.stdout:Unable to read consumer identity 2023-11-24T06:01:32.568 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 06:01:30 AM UTC. 2023-11-24T06:01:32.610 INFO:teuthology.orchestra.run.smithi106.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T06:01:32.639 INFO:teuthology.orchestra.run.smithi106.stderr:Error: No packages marked for reinstall. 2023-11-24T06:01:32.690 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q kernel | sort -rV | head -n 1 2023-11-24T06:01:32.763 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:00:02 ago on Fri 24 Nov 2023 06:01:30 AM UTC. 2023-11-24T06:01:32.769 INFO:teuthology.orchestra.run.smithi106.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:32.770 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:32.770 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-24T06:01:32.770 DEBUG:teuthology.parallel:result is None 2023-11-24T06:01:32.805 INFO:teuthology.orchestra.run.smithi176.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-11-24T06:01:32.826 INFO:teuthology.orchestra.run.smithi176.stderr:Error: No packages marked for reinstall. 2023-11-24T06:01:32.878 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q kernel | sort -rV | head -n 1 2023-11-24T06:01:32.958 INFO:teuthology.orchestra.run.smithi176.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:32.958 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-11-24T06:01:32.958 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-11-24T06:01:32.959 DEBUG:teuthology.parallel:result is None 2023-11-24T06:01:32.959 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-24T06:01:32.968 INFO:teuthology.task.internal:Creating test directory... 2023-11-24T06:01:32.968 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:01:32.971 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-24T06:01:32.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-24T06:01:32.995 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-24T06:01:33.005 INFO:teuthology.task.internal:Creating archive directory... 2023-11-24T06:01:33.005 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:01:33.028 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-24T06:01:33.058 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-24T06:01:33.065 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-24T06:01:33.066 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:01:33.096 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-24T06:01:33.133 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:33.144 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:33.146 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:33.163 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-24T06:01:33.164 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-24T06:01:33.171 INFO:teuthology.task.internal:Configuring sudo... 2023-11-24T06:01:33.171 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:01:33.188 DEBUG:teuthology.orchestra.run.smithi176:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-24T06:01:33.214 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-24T06:01:33.223 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-24T06:01:33.223 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:01:33.255 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-24T06:01:33.271 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:33.354 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:33.403 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:33.486 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:33.526 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:01:33.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:01:33.594 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:33.636 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-24T06:01:33.690 DEBUG:teuthology.orchestra.run.smithi176:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:33.773 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-24T06:01:33.814 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:01:33.815 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-24T06:01:33.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2023-11-24T06:01:33.884 DEBUG:teuthology.orchestra.run.smithi176:> sudo service rsyslog restart 2023-11-24T06:01:33.967 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:01:34.009 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:01:34.385 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-24T06:01:34.394 INFO:teuthology.task.internal:Starting timer... 2023-11-24T06:01:34.394 INFO:teuthology.run_tasks:Running task pcp... 2023-11-24T06:01:34.417 INFO:teuthology.run_tasks:Running task selinux... 2023-11-24T06:01:34.429 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-11-24T06:01:34.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo service auditd rotate 2023-11-24T06:01:34.509 INFO:teuthology.orchestra.run.smithi106.stdout:Rotating logs: 2023-11-24T06:01:34.511 DEBUG:teuthology.orchestra.run.smithi176:> sudo service auditd rotate 2023-11-24T06:01:34.576 INFO:teuthology.orchestra.run.smithi176.stdout:Rotating logs: 2023-11-24T06:01:34.578 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-24T06:01:34.578 DEBUG:teuthology.orchestra.run.smithi106:> /usr/sbin/getenforce 2023-11-24T06:01:34.603 INFO:teuthology.orchestra.run.smithi106.stdout:Permissive 2023-11-24T06:01:34.604 DEBUG:teuthology.orchestra.run.smithi176:> /usr/sbin/getenforce 2023-11-24T06:01:34.635 INFO:teuthology.orchestra.run.smithi176.stdout:Permissive 2023-11-24T06:01:34.635 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi106.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi176.front.sepia.ceph.com': 'permissive'} 2023-11-24T06:01:34.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:01:34.671 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:34.672 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:01:34.702 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:01:34.703 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-24T06:01:34.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo /usr/sbin/setenforce permissive 2023-11-24T06:01:34.739 DEBUG:teuthology.orchestra.run.smithi176:> sudo /usr/sbin/setenforce permissive 2023-11-24T06:01:34.773 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-24T06:01:34.783 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-11-24T06:01:34.784 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-24T06:01:34.798 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-24T06:01:34.799 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi176.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-24T06:10:18.232 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi176.front.sepia.ceph.com')] 2023-11-24T06:10:18.233 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-24T06:10:18.234 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:10:18.303 DEBUG:teuthology.orchestra.run.smithi106:> true 2023-11-24T06:10:18.327 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2023-11-24T06:10:18.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-24T06:10:18.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi176.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-24T06:10:18.395 DEBUG:teuthology.orchestra.run.smithi176:> true 2023-11-24T06:10:18.463 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi176.front.sepia.ceph.com' 2023-11-24T06:10:18.463 INFO:teuthology.run_tasks:Running task clock... 2023-11-24T06:10:18.473 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-24T06:10:18.474 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:10:18.474 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:10:18.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-24T06:10:18.476 DEBUG:teuthology.orchestra.run.smithi176:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:10:18.505 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:10:18.519 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:10:18.534 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-11-24T06:10:18.548 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-11-24T06:10:18.592 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: ntpd: command not found 2023-11-24T06:10:18.603 INFO:teuthology.orchestra.run.smithi106.stdout:506 Cannot talk to daemon 2023-11-24T06:10:18.617 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:10:18.621 INFO:teuthology.orchestra.run.smithi176.stderr:sudo: ntpd: command not found 2023-11-24T06:10:18.630 INFO:teuthology.orchestra.run.smithi106.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:10:18.632 INFO:teuthology.orchestra.run.smithi176.stdout:506 Cannot talk to daemon 2023-11-24T06:10:18.647 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-11-24T06:10:18.661 INFO:teuthology.orchestra.run.smithi176.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-11-24T06:10:18.709 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2023-11-24T06:10:18.712 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:10:18.712 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2023-11-24T06:10:18.712 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.712 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.713 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.713 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.724 INFO:teuthology.orchestra.run.smithi176.stderr:bash: ntpq: command not found 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.728 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:10:18.729 INFO:teuthology.run_tasks:Running task install... 2023-11-24T06:10:18.737 DEBUG:teuthology.task.install:project ceph 2023-11-24T06:10:18.737 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}} 2023-11-24T06:10:18.737 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'} 2023-11-24T06:10:18.737 INFO:teuthology.task.install:Using flavor: default 2023-11-24T06:10:18.742 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-24T06:10:18.743 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-24T06:10:18.743 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:10:18.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:10:18.745 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'tag': None, 'wait_for_package': False} 2023-11-24T06:10:18.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:10:18.891 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/ 2023-11-24T06:10:18.891 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:10:19.096 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/ 2023-11-24T06:10:19.096 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7484.ga13ea5ff 2023-11-24T06:10:19.174 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:10:19.174 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:10:19.174 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:10:19.203 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:10:19.203 DEBUG:teuthology.orchestra.run.smithi106:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:10:19.206 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/rishabh-mgr-vol-misc/a13ea5ff00cb4df7a9cc941166ddeb358881144c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-11-24T06:10:19.206 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:10:19.206 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-11-24T06:10:19.235 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-11-24T06:10:19.235 DEBUG:teuthology.orchestra.run.smithi176:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a13ea5ff00cb4df7a9cc941166ddeb358881144c/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-11-24T06:10:19.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:10:19.304 DEBUG:teuthology.orchestra.run.smithi176:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-11-24T06:10:19.350 DEBUG:teuthology.orchestra.run.smithi106:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:10:19.382 DEBUG:teuthology.orchestra.run.smithi176:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-11-24T06:10:19.418 INFO:teuthology.orchestra.run.smithi106.stdout:check_obsoletes = 1 2023-11-24T06:10:19.420 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum clean all 2023-11-24T06:10:19.448 INFO:teuthology.orchestra.run.smithi176.stdout:check_obsoletes = 1 2023-11-24T06:10:19.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum clean all 2023-11-24T06:10:19.791 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2023-11-24T06:10:19.819 INFO:teuthology.orchestra.run.smithi176.stdout:Updating Subscription Management repositories. 2023-11-24T06:10:20.044 INFO:teuthology.orchestra.run.smithi106.stdout:44 files removed 2023-11-24T06:10:20.051 INFO:teuthology.orchestra.run.smithi176.stdout:44 files removed 2023-11-24T06:10:20.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:10:20.098 DEBUG:teuthology.orchestra.run.smithi176:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-11-24T06:10:20.421 INFO:teuthology.orchestra.run.smithi106.stdout:Updating Subscription Management repositories. 2023-11-24T06:10:20.429 INFO:teuthology.orchestra.run.smithi176.stdout:Updating Subscription Management repositories. 2023-11-24T06:10:21.357 INFO:teuthology.orchestra.run.smithi176.stdout:ceph packages for x86_64 150 kB/s | 81 kB 00:00 2023-11-24T06:10:21.532 INFO:teuthology.orchestra.run.smithi106.stdout:ceph packages for x86_64 110 kB/s | 81 kB 00:00 2023-11-24T06:10:21.925 INFO:teuthology.orchestra.run.smithi176.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-11-24T06:10:21.933 INFO:teuthology.orchestra.run.smithi106.stdout:ceph noarch packages 26 kB/s | 9.5 kB 00:00 2023-11-24T06:10:22.375 INFO:teuthology.orchestra.run.smithi176.stdout:ceph source packages 3.5 kB/s | 1.5 kB 00:00 2023-11-24T06:10:22.542 INFO:teuthology.orchestra.run.smithi106.stdout:ceph source packages 2.5 kB/s | 1.5 kB 00:00 2023-11-24T06:10:22.676 INFO:teuthology.orchestra.run.smithi176.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-11-24T06:10:22.751 INFO:teuthology.orchestra.run.smithi106.stdout:Copr repo for python3-asyncssh owned by ceph 18 kB/s | 3.5 kB 00:00 2023-11-24T06:10:24.729 INFO:teuthology.orchestra.run.smithi106.stdout:Extra Packages for Enterprise Linux 8.2 MB/s | 16 MB 00:01 2023-11-24T06:10:28.235 INFO:teuthology.orchestra.run.smithi106.stdout:lab-extras 428 kB/s | 24 kB 00:00 2023-11-24T06:10:29.121 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 58 MB/s | 47 MB 00:00 2023-11-24T06:10:33.244 INFO:teuthology.orchestra.run.smithi176.stdout:Extra Packages for Enterprise Linux 1.5 MB/s | 16 MB 00:10 2023-11-24T06:10:36.784 INFO:teuthology.orchestra.run.smithi176.stdout:lab-extras 252 kB/s | 24 kB 00:00 2023-11-24T06:10:37.072 INFO:teuthology.orchestra.run.smithi106.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-11-24T06:10:37.636 INFO:teuthology.orchestra.run.smithi176.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 61 MB/s | 47 MB 00:00 2023-11-24T06:10:45.536 INFO:teuthology.orchestra.run.smithi176.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-11-24T06:10:48.320 INFO:teuthology.orchestra.run.smithi106.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T06:10:48.321 INFO:teuthology.orchestra.run.smithi106.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T06:10:48.336 INFO:teuthology.orchestra.run.smithi106.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-24T06:10:48.337 INFO:teuthology.orchestra.run.smithi106.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-24T06:10:48.338 INFO:teuthology.orchestra.run.smithi106.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-24T06:10:48.340 INFO:teuthology.orchestra.run.smithi106.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-24T06:10:48.342 INFO:teuthology.orchestra.run.smithi106.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-24T06:10:48.345 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-24T06:10:48.347 INFO:teuthology.orchestra.run.smithi106.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-24T06:10:48.478 INFO:teuthology.orchestra.run.smithi106.stdout:Dependencies resolved. 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout:=========================================================================================================================== 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout: Package Arch Version Repository Size 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout:=========================================================================================================================== 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout:Installing: 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.4 k 2023-11-24T06:10:48.490 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 5.4 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 920 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 171 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 1.6 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 133 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 1.8 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 7.4 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 50 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 14 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 49 M 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 262 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 407 k 2023-11-24T06:10:48.491 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 262 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 18 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 31 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 839 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 139 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-24T06:10:48.492 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 197 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 371 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 364 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 107 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 94 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.6 M 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 181 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrading: 2023-11-24T06:10:48.493 INFO:teuthology.orchestra.run.smithi106.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.8 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.7 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout:Installing dependencies: 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 23 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 28 k 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 2.3 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 243 k 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 4.6 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 18 M 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 15 k 2023-11-24T06:10:48.494 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 24 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 183 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-24T06:10:48.495 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 517 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.9 M 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-24T06:10:48.496 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 45 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 128 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-24T06:10:48.497 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-24T06:10:48.498 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-24T06:10:48.499 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-24T06:10:48.500 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout:Enabling module streams: 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql 10 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:10:48.501 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction Summary 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:=========================================================================================================================== 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:Install 128 Packages 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:Upgrade 3 Packages 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:Total download size: 209 M 2023-11-24T06:10:48.502 INFO:teuthology.orchestra.run.smithi106.stdout:Downloading Packages: 2023-11-24T06:10:48.756 INFO:teuthology.orchestra.run.smithi106.stdout:(1/131): ceph-18.0.0-7484.ga13ea5ff.el8.x86_64. 55 kB/s | 6.4 kB 00:00 2023-11-24T06:10:48.922 INFO:teuthology.orchestra.run.smithi106.stdout:(2/131): ceph-fuse-18.0.0-7484.ga13ea5ff.el8.x8 5.4 MB/s | 920 kB 00:00 2023-11-24T06:10:48.973 INFO:teuthology.orchestra.run.smithi106.stdout:(3/131): ceph-immutable-object-cache-18.0.0-748 3.3 MB/s | 171 kB 00:00 2023-11-24T06:10:49.273 INFO:teuthology.orchestra.run.smithi106.stdout:(4/131): ceph-mds-18.0.0-7484.ga13ea5ff.el8.x86 7.7 MB/s | 2.3 MB 00:00 2023-11-24T06:10:49.515 INFO:teuthology.orchestra.run.smithi106.stdout:(5/131): ceph-mgr-18.0.0-7484.ga13ea5ff.el8.x86 6.7 MB/s | 1.6 MB 00:00 2023-11-24T06:10:49.607 INFO:teuthology.orchestra.run.smithi106.stdout:(6/131): ceph-base-18.0.0-7484.ga13ea5ff.el8.x8 5.5 MB/s | 5.4 MB 00:00 2023-11-24T06:10:50.049 INFO:teuthology.orchestra.run.smithi106.stdout:(7/131): ceph-mon-18.0.0-7484.ga13ea5ff.el8.x86 8.7 MB/s | 4.6 MB 00:00 2023-11-24T06:10:51.313 INFO:teuthology.orchestra.run.smithi106.stdout:(8/131): ceph-common-18.0.0-7484.ga13ea5ff.el8. 8.4 MB/s | 23 MB 00:02 2023-11-24T06:10:51.391 INFO:teuthology.orchestra.run.smithi106.stdout:(9/131): ceph-selinux-18.0.0-7484.ga13ea5ff.el8 311 kB/s | 24 kB 00:00 2023-11-24T06:10:51.583 INFO:teuthology.orchestra.run.smithi106.stdout:(10/131): ceph-osd-18.0.0-7484.ga13ea5ff.el8.x8 9.1 MB/s | 18 MB 00:01 2023-11-24T06:10:51.742 INFO:teuthology.orchestra.run.smithi106.stdout:(11/131): ceph-radosgw-18.0.0-7484.ga13ea5ff.el 8.2 MB/s | 14 MB 00:01 2023-11-24T06:10:51.767 INFO:teuthology.orchestra.run.smithi106.stdout:(12/131): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 1.4 MB/s | 262 kB 00:00 2023-11-24T06:10:51.784 INFO:teuthology.orchestra.run.smithi106.stdout:(13/131): libcephfs-devel-18.0.0-7484.ga13ea5ff 745 kB/s | 31 kB 00:00 2023-11-24T06:10:51.843 INFO:teuthology.orchestra.run.smithi106.stdout:(14/131): libcephsqlite-18.0.0-7484.ga13ea5ff.e 3.1 MB/s | 183 kB 00:00 2023-11-24T06:10:51.893 INFO:teuthology.orchestra.run.smithi106.stdout:(15/131): libcephfs2-18.0.0-7484.ga13ea5ff.el8. 6.5 MB/s | 839 kB 00:00 2023-11-24T06:10:51.918 INFO:teuthology.orchestra.run.smithi106.stdout:(16/131): librados-devel-18.0.0-7484.ga13ea5ff. 1.8 MB/s | 139 kB 00:00 2023-11-24T06:10:51.977 INFO:teuthology.orchestra.run.smithi106.stdout:(17/131): libradosstriper1-18.0.0-7484.ga13ea5f 6.0 MB/s | 517 kB 00:00 2023-11-24T06:10:52.052 INFO:teuthology.orchestra.run.smithi106.stdout:(18/131): python3-ceph-argparse-18.0.0-7484.ga1 599 kB/s | 45 kB 00:00 2023-11-24T06:10:52.144 INFO:teuthology.orchestra.run.smithi106.stdout:(19/131): python3-ceph-common-18.0.0-7484.ga13e 1.4 MB/s | 128 kB 00:00 2023-11-24T06:10:52.228 INFO:teuthology.orchestra.run.smithi106.stdout:(20/131): python3-cephfs-18.0.0-7484.ga13ea5ff. 2.3 MB/s | 197 kB 00:00 2023-11-24T06:10:52.320 INFO:teuthology.orchestra.run.smithi106.stdout:(21/131): python3-rados-18.0.0-7484.ga13ea5ff.e 4.0 MB/s | 371 kB 00:00 2023-11-24T06:10:52.412 INFO:teuthology.orchestra.run.smithi106.stdout:(22/131): python3-rbd-18.0.0-7484.ga13ea5ff.el8 3.9 MB/s | 364 kB 00:00 2023-11-24T06:10:52.562 INFO:teuthology.orchestra.run.smithi106.stdout:(23/131): librgw2-18.0.0-7484.ga13ea5ff.el8.x86 11 MB/s | 6.9 MB 00:00 2023-11-24T06:10:52.587 INFO:teuthology.orchestra.run.smithi106.stdout:(24/131): python3-rgw-18.0.0-7484.ga13ea5ff.el8 609 kB/s | 107 kB 00:00 2023-11-24T06:10:52.621 INFO:teuthology.orchestra.run.smithi106.stdout:(25/131): rbd-fuse-18.0.0-7484.ga13ea5ff.el8.x8 1.6 MB/s | 94 kB 00:00 2023-11-24T06:10:52.680 INFO:teuthology.orchestra.run.smithi106.stdout:(26/131): rbd-nbd-18.0.0-7484.ga13ea5ff.el8.x86 3.0 MB/s | 181 kB 00:00 2023-11-24T06:10:52.730 INFO:teuthology.orchestra.run.smithi106.stdout:(27/131): ceph-grafana-dashboards-18.0.0-7484.g 557 kB/s | 28 kB 00:00 2023-11-24T06:10:52.788 INFO:teuthology.orchestra.run.smithi106.stdout:(28/131): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 2.2 MB/s | 133 kB 00:00 2023-11-24T06:10:53.006 INFO:teuthology.orchestra.run.smithi106.stdout:(29/131): rbd-mirror-18.0.0-7484.ga13ea5ff.el8. 8.6 MB/s | 3.6 MB 00:00 2023-11-24T06:10:53.048 INFO:teuthology.orchestra.run.smithi106.stdout:(30/131): ceph-mgr-dashboard-18.0.0-7484.ga13ea 6.8 MB/s | 1.8 MB 00:00 2023-11-24T06:10:53.106 INFO:teuthology.orchestra.run.smithi106.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.ga1 4.1 MB/s | 243 kB 00:00 2023-11-24T06:10:53.173 INFO:teuthology.orchestra.run.smithi106.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 751 kB/s | 50 kB 00:00 2023-11-24T06:10:53.240 INFO:teuthology.orchestra.run.smithi106.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.ga 223 kB/s | 15 kB 00:00 2023-11-24T06:10:53.316 INFO:teuthology.orchestra.run.smithi106.stdout:(34/131): ceph-volume-18.0.0-7484.ga13ea5ff.el8 3.4 MB/s | 262 kB 00:00 2023-11-24T06:10:53.623 INFO:teuthology.orchestra.run.smithi106.stdout:(35/131): cephadm-18.0.0-7484.ga13ea5ff.el8.noa 1.3 MB/s | 407 kB 00:00 2023-11-24T06:10:53.692 INFO:teuthology.orchestra.run.smithi106.stdout:(36/131): cephfs-top-18.0.0-7484.ga13ea5ff.el8. 264 kB/s | 18 kB 00:00 2023-11-24T06:10:53.776 INFO:teuthology.orchestra.run.smithi106.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 9.6 MB/s | 7.4 MB 00:00 2023-11-24T06:10:54.334 INFO:teuthology.orchestra.run.smithi106.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 105 kB/s | 59 kB 00:00 2023-11-24T06:10:54.534 INFO:teuthology.orchestra.run.smithi106.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 376 kB/s | 75 kB 00:00 2023-11-24T06:10:54.601 INFO:teuthology.orchestra.run.smithi106.stdout:(40/131): gperftools-libs-2.7-9.el8.x86_64.rpm 337 kB/s | 306 kB 00:00 2023-11-24T06:10:54.718 INFO:teuthology.orchestra.run.smithi106.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 374 kB/s | 44 kB 00:00 2023-11-24T06:10:55.285 INFO:teuthology.orchestra.run.smithi106.stdout:(42/131): ceph-test-18.0.0-7484.ga13ea5ff.el8.x 13 MB/s | 49 MB 00:03 2023-11-24T06:10:55.310 INFO:teuthology.orchestra.run.smithi106.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 313 kB/s | 185 kB 00:00 2023-11-24T06:10:55.336 INFO:teuthology.orchestra.run.smithi106.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 594 kB/s | 476 kB 00:00 2023-11-24T06:10:55.411 INFO:teuthology.orchestra.run.smithi106.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-11-24T06:10:55.636 INFO:teuthology.orchestra.run.smithi106.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 575 kB/s | 173 kB 00:00 2023-11-24T06:10:55.728 INFO:teuthology.orchestra.run.smithi106.stdout:(47/131): python3-cachetools-3.1.1-4.el8.noarch 75 kB/s | 33 kB 00:00 2023-11-24T06:10:55.828 INFO:teuthology.orchestra.run.smithi106.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 423 kB/s | 81 kB 00:00 2023-11-24T06:10:55.854 INFO:teuthology.orchestra.run.smithi106.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-11-24T06:10:55.937 INFO:teuthology.orchestra.run.smithi106.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-11-24T06:10:56.004 INFO:teuthology.orchestra.run.smithi106.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 648 kB/s | 384 kB 00:00 2023-11-24T06:10:56.046 INFO:teuthology.orchestra.run.smithi106.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 448 kB/s | 49 kB 00:00 2023-11-24T06:10:56.113 INFO:teuthology.orchestra.run.smithi106.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 541 kB/s | 59 kB 00:00 2023-11-24T06:10:56.155 INFO:teuthology.orchestra.run.smithi106.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2023-11-24T06:10:56.264 INFO:teuthology.orchestra.run.smithi106.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-11-24T06:10:56.372 INFO:teuthology.orchestra.run.smithi106.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2023-11-24T06:10:56.481 INFO:teuthology.orchestra.run.smithi106.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 769 kB/s | 283 kB 00:00 2023-11-24T06:10:56.581 INFO:teuthology.orchestra.run.smithi106.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 643 kB/s | 64 kB 00:00 2023-11-24T06:10:56.648 INFO:teuthology.orchestra.run.smithi106.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 712 kB/s | 196 kB 00:00 2023-11-24T06:10:56.676 INFO:teuthology.orchestra.run.smithi176.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T06:10:56.677 INFO:teuthology.orchestra.run.smithi176.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-11-24T06:10:56.682 INFO:teuthology.orchestra.run.smithi106.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 186 kB/s | 19 kB 00:00 2023-11-24T06:10:56.691 INFO:teuthology.orchestra.run.smithi176.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-11-24T06:10:56.692 INFO:teuthology.orchestra.run.smithi176.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-11-24T06:10:56.693 INFO:teuthology.orchestra.run.smithi176.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-11-24T06:10:56.694 INFO:teuthology.orchestra.run.smithi176.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-11-24T06:10:56.696 INFO:teuthology.orchestra.run.smithi176.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-11-24T06:10:56.699 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-11-24T06:10:56.701 INFO:teuthology.orchestra.run.smithi176.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-11-24T06:10:56.766 INFO:teuthology.orchestra.run.smithi106.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 204 kB/s | 24 kB 00:00 2023-11-24T06:10:56.791 INFO:teuthology.orchestra.run.smithi106.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-11-24T06:10:56.831 INFO:teuthology.orchestra.run.smithi176.stdout:Dependencies resolved. 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout:=========================================================================================================================== 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout: Package Arch Version Repository Size 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout:=========================================================================================================================== 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout:Installing: 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-11-24T06:10:56.843 INFO:teuthology.orchestra.run.smithi176.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.4 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 5.4 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 920 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 171 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 1.6 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 133 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 1.8 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 7.4 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 50 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 14 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 49 M 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 262 k 2023-11-24T06:10:56.844 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 407 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 262 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 18 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 31 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 839 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 139 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-11-24T06:10:56.845 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 197 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 371 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 364 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 107 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 94 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.6 M 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 181 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrading: 2023-11-24T06:10:56.846 INFO:teuthology.orchestra.run.smithi176.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: librados2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.8 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 3.7 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout:Installing dependencies: 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 23 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 28 k 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 2.3 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 243 k 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 4.6 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 18 M 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7484.ga13ea5ff.el8 ceph-noarch 15 k 2023-11-24T06:10:56.847 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 24 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 183 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-11-24T06:10:56.848 INFO:teuthology.orchestra.run.smithi176.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 517 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2 x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 6.9 M 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-11-24T06:10:56.849 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-11-24T06:10:56.850 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 45 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common x86_64 2:18.0.0-7484.ga13ea5ff.el8 ceph 128 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-11-24T06:10:56.851 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-11-24T06:10:56.852 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-11-24T06:10:56.853 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-11-24T06:10:56.854 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout:Enabling module streams: 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql 10 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction Summary 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout:=========================================================================================================================== 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout:Install 128 Packages 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout:Upgrade 3 Packages 2023-11-24T06:10:56.855 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:10:56.856 INFO:teuthology.orchestra.run.smithi176.stdout:Total download size: 209 M 2023-11-24T06:10:56.856 INFO:teuthology.orchestra.run.smithi176.stdout:Downloading Packages: 2023-11-24T06:10:56.874 INFO:teuthology.orchestra.run.smithi106.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 254 kB/s | 27 kB 00:00 2023-11-24T06:10:57.150 INFO:teuthology.orchestra.run.smithi106.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 712 kB/s | 255 kB 00:00 2023-11-24T06:10:57.233 INFO:teuthology.orchestra.run.smithi106.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 700 kB/s | 251 kB 00:00 2023-11-24T06:10:57.268 INFO:teuthology.orchestra.run.smithi106.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 524 kB/s | 61 kB 00:00 2023-11-24T06:10:57.328 INFO:teuthology.orchestra.run.smithi176.stdout:(1/131): ceph-18.0.0-7484.ga13ea5ff.el8.x86_64. 30 kB/s | 6.4 kB 00:00 2023-11-24T06:10:57.376 INFO:teuthology.orchestra.run.smithi106.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 212 kB/s | 23 kB 00:00 2023-11-24T06:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout:(68/131): python3-kubernetes-11.0.0-6.el8.noarc 750 kB/s | 1.2 MB 00:01 2023-11-24T06:10:57.477 INFO:teuthology.orchestra.run.smithi106.stdout:(69/131): python3-webtest-2.0.33-1.el8.noarch.r 352 kB/s | 85 kB 00:00 2023-11-24T06:10:57.502 INFO:teuthology.orchestra.run.smithi106.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.2 MB/s | 70 kB 00:00 2023-11-24T06:10:57.560 INFO:teuthology.orchestra.run.smithi106.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-11-24T06:10:57.602 INFO:teuthology.orchestra.run.smithi106.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-11-24T06:10:57.644 INFO:teuthology.orchestra.run.smithi106.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-11-24T06:10:57.686 INFO:teuthology.orchestra.run.smithi106.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-11-24T06:10:57.720 INFO:teuthology.orchestra.run.smithi106.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-11-24T06:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-11-24T06:10:57.845 INFO:teuthology.orchestra.run.smithi106.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 7.9 MB/s | 538 kB 00:00 2023-11-24T06:10:57.887 INFO:teuthology.orchestra.run.smithi106.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-11-24T06:10:58.021 INFO:teuthology.orchestra.run.smithi106.stdout:(79/131): python3-scipy-1.0.0-21.module+el8.5.0 25 MB/s | 14 MB 00:00 2023-11-24T06:10:58.046 INFO:teuthology.orchestra.run.smithi106.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-11-24T06:10:58.089 INFO:teuthology.orchestra.run.smithi106.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-11-24T06:10:58.122 INFO:teuthology.orchestra.run.smithi106.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 803 kB/s | 27 kB 00:00 2023-11-24T06:10:58.184 INFO:teuthology.orchestra.run.smithi106.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 5.0 MB/s | 320 kB 00:00 2023-11-24T06:10:58.256 INFO:teuthology.orchestra.run.smithi106.stdout:(84/131): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-11-24T06:10:58.283 INFO:teuthology.orchestra.run.smithi106.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 457 kB/s | 44 kB 00:00 2023-11-24T06:10:58.323 INFO:teuthology.orchestra.run.smithi106.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 11 MB/s | 457 kB 00:00 2023-11-24T06:10:58.365 INFO:teuthology.orchestra.run.smithi106.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-11-24T06:10:58.423 INFO:teuthology.orchestra.run.smithi106.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 22 MB/s | 3.7 MB 00:00 2023-11-24T06:10:58.449 INFO:teuthology.orchestra.run.smithi106.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 765 kB/s | 64 kB 00:00 2023-11-24T06:10:58.495 INFO:teuthology.orchestra.run.smithi176.stdout:(2/131): ceph-common-18.0.0-7484.ga13ea5ff.el8. 16 MB/s | 23 MB 00:01 2023-11-24T06:10:58.520 INFO:teuthology.orchestra.run.smithi176.stdout:(3/131): ceph-fuse-18.0.0-7484.ga13ea5ff.el8.x8 772 kB/s | 920 kB 00:01 2023-11-24T06:10:58.537 INFO:teuthology.orchestra.run.smithi176.stdout:(4/131): ceph-immutable-object-cache-18.0.0-748 4.0 MB/s | 171 kB 00:00 2023-11-24T06:10:58.591 INFO:teuthology.orchestra.run.smithi106.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 757 kB/s | 126 kB 00:00 2023-11-24T06:10:58.654 INFO:teuthology.orchestra.run.smithi176.stdout:(5/131): ceph-mgr-18.0.0-7484.ga13ea5ff.el8.x86 14 MB/s | 1.6 MB 00:00 2023-11-24T06:10:58.767 INFO:teuthology.orchestra.run.smithi106.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 63 kB/s | 20 kB 00:00 2023-11-24T06:10:58.771 INFO:teuthology.orchestra.run.smithi176.stdout:(6/131): ceph-base-18.0.0-7484.ga13ea5ff.el8.x8 3.2 MB/s | 5.4 MB 00:01 2023-11-24T06:10:58.792 INFO:teuthology.orchestra.run.smithi106.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 516 kB/s | 103 kB 00:00 2023-11-24T06:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-11-24T06:10:58.876 INFO:teuthology.orchestra.run.smithi106.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-11-24T06:10:58.921 INFO:teuthology.orchestra.run.smithi176.stdout:(7/131): ceph-mon-18.0.0-7484.ga13ea5ff.el8.x86 17 MB/s | 4.6 MB 00:00 2023-11-24T06:10:59.017 INFO:teuthology.orchestra.run.smithi106.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-11-24T06:10:59.068 INFO:teuthology.orchestra.run.smithi106.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 3.9 MB/s | 202 kB 00:00 2023-11-24T06:10:59.135 INFO:teuthology.orchestra.run.smithi106.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-11-24T06:10:59.160 INFO:teuthology.orchestra.run.smithi106.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.8 MB/s | 354 kB 00:00 2023-11-24T06:10:59.210 INFO:teuthology.orchestra.run.smithi106.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-11-24T06:10:59.319 INFO:teuthology.orchestra.run.smithi106.stdout:(100/131): postgresql-server-10.21-2.module+el8 28 MB/s | 5.1 MB 00:00 2023-11-24T06:10:59.352 INFO:teuthology.orchestra.run.smithi106.stdout:(101/131): postgresql-10.21-2.module+el8.6.0+15 11 MB/s | 1.5 MB 00:00 2023-11-24T06:10:59.403 INFO:teuthology.orchestra.run.smithi106.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 561 kB/s | 47 kB 00:00 2023-11-24T06:10:59.428 INFO:teuthology.orchestra.run.smithi106.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.6 MB/s | 200 kB 00:00 2023-11-24T06:10:59.454 INFO:teuthology.orchestra.run.smithi106.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-11-24T06:10:59.479 INFO:teuthology.orchestra.run.smithi106.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-11-24T06:10:59.504 INFO:teuthology.orchestra.run.smithi106.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 961 kB/s | 48 kB 00:00 2023-11-24T06:10:59.522 INFO:teuthology.orchestra.run.smithi106.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-11-24T06:10:59.546 INFO:teuthology.orchestra.run.smithi106.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-11-24T06:10:59.571 INFO:teuthology.orchestra.run.smithi106.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-11-24T06:10:59.596 INFO:teuthology.orchestra.run.smithi106.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-11-24T06:10:59.638 INFO:teuthology.orchestra.run.smithi106.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-11-24T06:10:59.656 INFO:teuthology.orchestra.run.smithi106.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-11-24T06:10:59.666 INFO:teuthology.orchestra.run.smithi176.stdout:(8/131): ceph-radosgw-18.0.0-7484.ga13ea5ff.el8 19 MB/s | 14 MB 00:00 2023-11-24T06:10:59.681 INFO:teuthology.orchestra.run.smithi106.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.6 MB/s | 155 kB 00:00 2023-11-24T06:10:59.716 INFO:teuthology.orchestra.run.smithi106.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-11-24T06:10:59.722 INFO:teuthology.orchestra.run.smithi176.stdout:(9/131): ceph-selinux-18.0.0-7484.ga13ea5ff.el8 440 kB/s | 24 kB 00:00 2023-11-24T06:10:59.765 INFO:teuthology.orchestra.run.smithi106.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 214 kB/s | 18 kB 00:00 2023-11-24T06:10:59.815 INFO:teuthology.orchestra.run.smithi106.stdout:(116/131): thrift-0.13.0-2.el8.x86_64.rpm 728 kB/s | 1.7 MB 00:02 2023-11-24T06:10:59.841 INFO:teuthology.orchestra.run.smithi106.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.1 MB/s | 238 kB 00:00 2023-11-24T06:10:59.874 INFO:teuthology.orchestra.run.smithi106.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.7 MB/s | 605 kB 00:00 2023-11-24T06:10:59.899 INFO:teuthology.orchestra.run.smithi106.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.3 MB/s | 72 kB 00:00 2023-11-24T06:10:59.925 INFO:teuthology.orchestra.run.smithi106.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-11-24T06:10:59.950 INFO:teuthology.orchestra.run.smithi106.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-11-24T06:10:59.967 INFO:teuthology.orchestra.run.smithi106.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-11-24T06:10:59.992 INFO:teuthology.orchestra.run.smithi106.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-11-24T06:11:00.018 INFO:teuthology.orchestra.run.smithi106.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-11-24T06:11:00.051 INFO:teuthology.orchestra.run.smithi106.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-11-24T06:11:00.077 INFO:teuthology.orchestra.run.smithi106.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-11-24T06:11:00.102 INFO:teuthology.orchestra.run.smithi106.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-11-24T06:11:00.169 INFO:teuthology.orchestra.run.smithi106.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-11-24T06:11:00.219 INFO:teuthology.orchestra.run.smithi106.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-24T06:11:00.697 INFO:teuthology.orchestra.run.smithi176.stdout:(10/131): ceph-mds-18.0.0-7484.ga13ea5ff.el8.x8 1.1 MB/s | 2.3 MB 00:02 2023-11-24T06:11:00.947 INFO:teuthology.orchestra.run.smithi176.stdout:(11/131): cephfs-mirror-18.0.0-7484.ga13ea5ff.e 1.0 MB/s | 262 kB 00:00 2023-11-24T06:11:01.047 INFO:teuthology.orchestra.run.smithi176.stdout:(12/131): libcephfs-devel-18.0.0-7484.ga13ea5ff 311 kB/s | 31 kB 00:00 2023-11-24T06:11:01.136 INFO:teuthology.orchestra.run.smithi106.stdout:(130/131): librados2-18.0.0-7484.ga13ea5ff.el8. 3.6 MB/s | 3.8 MB 00:01 2023-11-24T06:11:01.503 INFO:teuthology.orchestra.run.smithi106.stdout:(131/131): librbd1-18.0.0-7484.ga13ea5ff.el8.x8 2.6 MB/s | 3.7 MB 00:01 2023-11-24T06:11:01.507 INFO:teuthology.orchestra.run.smithi106.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:11:01.507 INFO:teuthology.orchestra.run.smithi106.stdout:Total 16 MB/s | 209 MB 00:13 2023-11-24T06:11:01.664 INFO:teuthology.orchestra.run.smithi176.stdout:(13/131): libcephfs2-18.0.0-7484.ga13ea5ff.el8. 1.3 MB/s | 839 kB 00:00 2023-11-24T06:11:01.806 INFO:teuthology.orchestra.run.smithi176.stdout:(14/131): libcephsqlite-18.0.0-7484.ga13ea5ff.e 1.3 MB/s | 183 kB 00:00 2023-11-24T06:11:01.940 INFO:teuthology.orchestra.run.smithi176.stdout:(15/131): librados-devel-18.0.0-7484.ga13ea5ff. 1.0 MB/s | 139 kB 00:00 2023-11-24T06:11:02.347 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction check 2023-11-24T06:11:02.468 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction check succeeded. 2023-11-24T06:11:02.468 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction test 2023-11-24T06:11:02.674 INFO:teuthology.orchestra.run.smithi176.stdout:(16/131): ceph-test-18.0.0-7484.ga13ea5ff.el8.x 17 MB/s | 49 MB 00:02 2023-11-24T06:11:02.707 INFO:teuthology.orchestra.run.smithi176.stdout:(17/131): libradosstriper1-18.0.0-7484.ga13ea5f 674 kB/s | 517 kB 00:00 2023-11-24T06:11:02.882 INFO:teuthology.orchestra.run.smithi176.stdout:(18/131): ceph-osd-18.0.0-7484.ga13ea5ff.el8.x8 4.4 MB/s | 18 MB 00:04 2023-11-24T06:11:02.908 INFO:teuthology.orchestra.run.smithi176.stdout:(19/131): python3-ceph-argparse-18.0.0-7484.ga1 223 kB/s | 45 kB 00:00 2023-11-24T06:11:02.966 INFO:teuthology.orchestra.run.smithi176.stdout:(20/131): python3-ceph-common-18.0.0-7484.ga13e 1.5 MB/s | 128 kB 00:00 2023-11-24T06:11:03.091 INFO:teuthology.orchestra.run.smithi176.stdout:(21/131): python3-cephfs-18.0.0-7484.ga13ea5ff. 1.0 MB/s | 197 kB 00:00 2023-11-24T06:11:03.117 INFO:teuthology.orchestra.run.smithi176.stdout:(22/131): python3-rados-18.0.0-7484.ga13ea5ff.e 2.4 MB/s | 371 kB 00:00 2023-11-24T06:11:03.201 INFO:teuthology.orchestra.run.smithi176.stdout:(23/131): librgw2-18.0.0-7484.ga13ea5ff.el8.x86 13 MB/s | 6.9 MB 00:00 2023-11-24T06:11:03.218 INFO:teuthology.orchestra.run.smithi176.stdout:(24/131): python3-rgw-18.0.0-7484.ga13ea5ff.el8 1.0 MB/s | 107 kB 00:00 2023-11-24T06:11:03.242 INFO:teuthology.orchestra.run.smithi176.stdout:(25/131): rbd-fuse-18.0.0-7484.ga13ea5ff.el8.x8 2.2 MB/s | 94 kB 00:00 2023-11-24T06:11:03.294 INFO:teuthology.orchestra.run.smithi176.stdout:(26/131): rbd-nbd-18.0.0-7484.ga13ea5ff.el8.x86 3.5 MB/s | 181 kB 00:00 2023-11-24T06:11:03.318 INFO:teuthology.orchestra.run.smithi176.stdout:(27/131): python3-rbd-18.0.0-7484.ga13ea5ff.el8 1.6 MB/s | 364 kB 00:00 2023-11-24T06:11:03.335 INFO:teuthology.orchestra.run.smithi176.stdout:(28/131): ceph-grafana-dashboards-18.0.0-7484.g 666 kB/s | 28 kB 00:00 2023-11-24T06:11:03.427 INFO:teuthology.orchestra.run.smithi176.stdout:(29/131): ceph-mgr-cephadm-18.0.0-7484.ga13ea5f 1.2 MB/s | 133 kB 00:00 2023-11-24T06:11:03.469 INFO:teuthology.orchestra.run.smithi176.stdout:(30/131): ceph-mgr-dashboard-18.0.0-7484.ga13ea 13 MB/s | 1.8 MB 00:00 2023-11-24T06:11:03.527 INFO:teuthology.orchestra.run.smithi176.stdout:(31/131): ceph-mgr-modules-core-18.0.0-7484.ga1 4.1 MB/s | 243 kB 00:00 2023-11-24T06:11:03.578 INFO:teuthology.orchestra.run.smithi176.stdout:(32/131): ceph-mgr-rook-18.0.0-7484.ga13ea5ff.e 1.0 MB/s | 50 kB 00:00 2023-11-24T06:11:03.612 INFO:teuthology.orchestra.run.smithi106.stdout:Transaction test succeeded. 2023-11-24T06:11:03.616 INFO:teuthology.orchestra.run.smithi106.stdout:Running transaction 2023-11-24T06:11:03.628 INFO:teuthology.orchestra.run.smithi176.stdout:(33/131): ceph-prometheus-alerts-18.0.0-7484.ga 300 kB/s | 15 kB 00:00 2023-11-24T06:11:03.695 INFO:teuthology.orchestra.run.smithi176.stdout:(34/131): ceph-volume-18.0.0-7484.ga13ea5ff.el8 3.8 MB/s | 262 kB 00:00 2023-11-24T06:11:03.754 INFO:teuthology.orchestra.run.smithi176.stdout:(35/131): cephadm-18.0.0-7484.ga13ea5ff.el8.noa 6.8 MB/s | 407 kB 00:00 2023-11-24T06:11:03.829 INFO:teuthology.orchestra.run.smithi176.stdout:(36/131): rbd-mirror-18.0.0-7484.ga13ea5ff.el8. 5.9 MB/s | 3.6 MB 00:00 2023-11-24T06:11:03.854 INFO:teuthology.orchestra.run.smithi176.stdout:(37/131): cephfs-top-18.0.0-7484.ga13ea5ff.el8. 180 kB/s | 18 kB 00:00 2023-11-24T06:11:04.096 INFO:teuthology.orchestra.run.smithi176.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 243 kB/s | 59 kB 00:00 2023-11-24T06:11:04.211 INFO:teuthology.orchestra.run.smithi176.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 801 kB/s | 306 kB 00:00 2023-11-24T06:11:04.238 INFO:teuthology.orchestra.run.smithi176.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2023-11-24T06:11:04.314 INFO:teuthology.orchestra.run.smithi176.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 581 kB/s | 44 kB 00:00 2023-11-24T06:11:04.431 INFO:teuthology.orchestra.run.smithi176.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.6 MB/s | 185 kB 00:00 2023-11-24T06:11:04.489 INFO:teuthology.orchestra.run.smithi176.stdout:(43/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-11-24T06:11:04.515 INFO:teuthology.orchestra.run.smithi176.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 394 kB/s | 33 kB 00:00 2023-11-24T06:11:04.548 INFO:teuthology.orchestra.run.smithi176.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 278 kB/s | 16 kB 00:00 2023-11-24T06:11:04.649 INFO:teuthology.orchestra.run.smithi176.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-11-24T06:11:04.749 INFO:teuthology.orchestra.run.smithi176.stdout:(47/131): python3-google-auth-1.1.1-10.el8.noar 814 kB/s | 81 kB 00:00 2023-11-24T06:11:04.816 INFO:teuthology.orchestra.run.smithi176.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.4 MB/s | 384 kB 00:00 2023-11-24T06:11:04.841 INFO:teuthology.orchestra.run.smithi176.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 121 kB/s | 11 kB 00:00 2023-11-24T06:11:04.875 INFO:teuthology.orchestra.run.smithi176.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-11-24T06:11:04.942 INFO:teuthology.orchestra.run.smithi176.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 730 kB/s | 49 kB 00:00 2023-11-24T06:11:05.017 INFO:teuthology.orchestra.run.smithi176.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 784 kB/s | 59 kB 00:00 2023-11-24T06:11:05.075 INFO:teuthology.orchestra.run.smithi176.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.0 MB/s | 60 kB 00:00 2023-11-24T06:11:05.276 INFO:teuthology.orchestra.run.smithi176.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.4 MB/s | 283 kB 00:00 2023-11-24T06:11:05.334 INFO:teuthology.orchestra.run.smithi176.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 268 kB/s | 16 kB 00:00 2023-11-24T06:11:05.410 INFO:teuthology.orchestra.run.smithi176.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 450 kB/s | 34 kB 00:00 2023-11-24T06:11:05.518 INFO:teuthology.orchestra.run.smithi176.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 1.7 MB/s | 1.2 MB 00:00 2023-11-24T06:11:05.577 INFO:teuthology.orchestra.run.smithi176.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-11-24T06:11:05.602 INFO:teuthology.orchestra.run.smithi176.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 770 kB/s | 64 kB 00:00 2023-11-24T06:11:05.636 INFO:teuthology.orchestra.run.smithi176.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 321 kB/s | 19 kB 00:00 2023-11-24T06:11:05.653 INFO:teuthology.orchestra.run.smithi176.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-11-24T06:11:05.686 INFO:teuthology.orchestra.run.smithi176.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-11-24T06:11:05.712 INFO:teuthology.orchestra.run.smithi176.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2023-11-24T06:11:05.845 INFO:teuthology.orchestra.run.smithi176.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.6 MB/s | 255 kB 00:00 2023-11-24T06:11:05.912 INFO:teuthology.orchestra.run.smithi176.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-11-24T06:11:05.938 INFO:teuthology.orchestra.run.smithi176.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 664 kB/s | 61 kB 00:00 2023-11-24T06:11:05.988 INFO:teuthology.orchestra.run.smithi176.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 459 kB/s | 23 kB 00:00 2023-11-24T06:11:06.013 INFO:teuthology.orchestra.run.smithi176.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 847 kB/s | 85 kB 00:00 2023-11-24T06:11:06.038 INFO:teuthology.orchestra.run.smithi176.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-11-24T06:11:06.231 INFO:teuthology.orchestra.run.smithi176.stdout:(70/131): ceph-mgr-diskprediction-local-18.0.0- 2.6 MB/s | 7.4 MB 00:02 2023-11-24T06:11:06.289 INFO:teuthology.orchestra.run.smithi176.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.9 MB/s | 110 kB 00:00 2023-11-24T06:11:06.343 INFO:teuthology.orchestra.run.smithi176.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-11-24T06:11:06.473 INFO:teuthology.orchestra.run.smithi176.stdout:(73/131): python3-scipy-1.0.0-21.module+el8.5.0 32 MB/s | 14 MB 00:00 2023-11-24T06:11:06.498 INFO:teuthology.orchestra.run.smithi176.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 1.5 MB/s | 259 kB 00:00 2023-11-24T06:11:06.524 INFO:teuthology.orchestra.run.smithi176.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-11-24T06:11:06.578 INFO:teuthology.orchestra.run.smithi176.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 484 kB/s | 39 kB 00:00 2023-11-24T06:11:06.624 INFO:teuthology.orchestra.run.smithi176.stdout:(77/131): thrift-0.13.0-2.el8.x86_64.rpm 2.7 MB/s | 1.7 MB 00:00 2023-11-24T06:11:06.657 INFO:teuthology.orchestra.run.smithi176.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 5.0 MB/s | 688 kB 00:00 2023-11-24T06:11:06.691 INFO:teuthology.orchestra.run.smithi176.stdout:(79/131): python3-jinja2-2.10.1-3.el8.noarch.rp 4.7 MB/s | 538 kB 00:00 2023-11-24T06:11:06.716 INFO:teuthology.orchestra.run.smithi176.stdout:(80/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-11-24T06:11:06.742 INFO:teuthology.orchestra.run.smithi176.stdout:(81/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.3 MB/s | 187 kB 00:00 2023-11-24T06:11:06.784 INFO:teuthology.orchestra.run.smithi176.stdout:(82/131): automake-1.16.1-7.el8.noarch.rpm 7.6 MB/s | 713 kB 00:00 2023-11-24T06:11:06.809 INFO:teuthology.orchestra.run.smithi176.stdout:(83/131): python3-jsonpatch-1.21-2.el8.noarch.r 397 kB/s | 27 kB 00:00 2023-11-24T06:11:06.834 INFO:teuthology.orchestra.run.smithi176.stdout:(84/131): flex-2.6.1-9.el8.x86_64.rpm 6.2 MB/s | 320 kB 00:00 2023-11-24T06:11:06.859 INFO:teuthology.orchestra.run.smithi176.stdout:(85/131): python3-prettytable-0.7.2-14.el8.noar 873 kB/s | 44 kB 00:00 2023-11-24T06:11:06.910 INFO:teuthology.orchestra.run.smithi176.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-11-24T06:11:06.973 INFO:teuthology.orchestra.run.smithi176.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 3.5 MB/s | 225 kB 00:00 2023-11-24T06:11:07.052 INFO:teuthology.orchestra.run.smithi176.stdout:(88/131): python3-babel-2.5.1-7.el8.noarch.rpm 14 MB/s | 4.8 MB 00:00 2023-11-24T06:11:07.119 INFO:teuthology.orchestra.run.smithi176.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 13 MB/s | 3.7 MB 00:00 2023-11-24T06:11:07.144 INFO:teuthology.orchestra.run.smithi176.stdout:(90/131): uuid-1.6.2-43.el8.x86_64.rpm 374 kB/s | 64 kB 00:00 2023-11-24T06:11:07.169 INFO:teuthology.orchestra.run.smithi176.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-11-24T06:11:07.194 INFO:teuthology.orchestra.run.smithi176.stdout:(92/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 889 kB/s | 126 kB 00:00 2023-11-24T06:11:07.220 INFO:teuthology.orchestra.run.smithi176.stdout:(93/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.3 MB/s | 103 kB 00:00 2023-11-24T06:11:07.253 INFO:teuthology.orchestra.run.smithi176.stdout:(94/131): libtool-2.4.6-25.el8.x86_64.rpm 8.3 MB/s | 709 kB 00:00 2023-11-24T06:11:07.279 INFO:teuthology.orchestra.run.smithi176.stdout:(95/131): libpq-13.5-1.el8.x86_64.rpm 3.3 MB/s | 198 kB 00:00 2023-11-24T06:11:07.320 INFO:teuthology.orchestra.run.smithi176.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-11-24T06:11:07.388 INFO:teuthology.orchestra.run.smithi176.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.2 MB/s | 354 kB 00:00 2023-11-24T06:11:07.480 INFO:teuthology.orchestra.run.smithi176.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 17 MB/s | 4.9 MB 00:00 2023-11-24T06:11:07.547 INFO:teuthology.orchestra.run.smithi176.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-11-24T06:11:07.589 INFO:teuthology.orchestra.run.smithi176.stdout:(100/131): postgresql-contrib-10.21-2.module+el 7.3 MB/s | 808 kB 00:00 2023-11-24T06:11:07.614 INFO:teuthology.orchestra.run.smithi176.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2023-11-24T06:11:07.656 INFO:teuthology.orchestra.run.smithi176.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-11-24T06:11:07.681 INFO:teuthology.orchestra.run.smithi176.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-11-24T06:11:07.698 INFO:teuthology.orchestra.run.smithi176.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-11-24T06:11:07.723 INFO:teuthology.orchestra.run.smithi176.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-11-24T06:11:07.770 INFO:teuthology.orchestra.run.smithi176.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 668 kB/s | 48 kB 00:00 2023-11-24T06:11:07.799 INFO:teuthology.orchestra.run.smithi176.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2023-11-24T06:11:07.816 INFO:teuthology.orchestra.run.smithi176.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 941 kB/s | 43 kB 00:00 2023-11-24T06:11:07.841 INFO:teuthology.orchestra.run.smithi176.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-11-24T06:11:07.866 INFO:teuthology.orchestra.run.smithi176.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-11-24T06:11:07.900 INFO:teuthology.orchestra.run.smithi176.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-11-24T06:11:07.925 INFO:teuthology.orchestra.run.smithi176.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 320 kB/s | 19 kB 00:00 2023-11-24T06:11:07.950 INFO:teuthology.orchestra.run.smithi176.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-11-24T06:11:08.018 INFO:teuthology.orchestra.run.smithi176.stdout:(114/131): postgresql-server-10.21-2.module+el8 8.0 MB/s | 5.1 MB 00:00 2023-11-24T06:11:08.043 INFO:teuthology.orchestra.run.smithi176.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 195 kB/s | 18 kB 00:00 2023-11-24T06:11:08.077 INFO:teuthology.orchestra.run.smithi176.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.6 MB/s | 559 kB 00:00 2023-11-24T06:11:08.102 INFO:teuthology.orchestra.run.smithi176.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-11-24T06:11:08.157 INFO:teuthology.orchestra.run.smithi176.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.0 MB/s | 238 kB 00:00 2023-11-24T06:11:08.185 INFO:teuthology.orchestra.run.smithi176.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 866 kB/s | 72 kB 00:00 2023-11-24T06:11:08.211 INFO:teuthology.orchestra.run.smithi176.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.5 MB/s | 83 kB 00:00 2023-11-24T06:11:08.236 INFO:teuthology.orchestra.run.smithi176.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-11-24T06:11:08.253 INFO:teuthology.orchestra.run.smithi176.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 2.3 MB/s | 98 kB 00:00 2023-11-24T06:11:08.278 INFO:teuthology.orchestra.run.smithi176.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.3 MB/s | 58 kB 00:00 2023-11-24T06:11:08.320 INFO:teuthology.orchestra.run.smithi176.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 577 kB/s | 39 kB 00:00 2023-11-24T06:11:08.362 INFO:teuthology.orchestra.run.smithi176.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-11-24T06:11:08.387 INFO:teuthology.orchestra.run.smithi176.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-11-24T06:11:08.413 INFO:teuthology.orchestra.run.smithi176.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-11-24T06:11:08.463 INFO:teuthology.orchestra.run.smithi176.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.0 MB/s | 2.3 MB 00:00 2023-11-24T06:11:08.514 INFO:teuthology.orchestra.run.smithi176.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-11-24T06:11:08.710 INFO:teuthology.orchestra.run.smithi106.stdout: Preparing : 1/1 2023-11-24T06:11:08.893 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-24T06:11:09.046 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-24T06:11:09.080 INFO:teuthology.orchestra.run.smithi176.stdout:(130/131): librbd1-18.0.0-7484.ga13ea5ff.el8.x8 5.6 MB/s | 3.7 MB 00:00 2023-11-24T06:11:09.560 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-24T06:11:09.563 INFO:teuthology.orchestra.run.smithi176.stdout:(131/131): librados2-18.0.0-7484.ga13ea5ff.el8. 3.2 MB/s | 3.8 MB 00:01 2023-11-24T06:11:09.567 INFO:teuthology.orchestra.run.smithi176.stdout:-------------------------------------------------------------------------------- 2023-11-24T06:11:09.568 INFO:teuthology.orchestra.run.smithi176.stdout:Total 16 MB/s | 209 MB 00:12 2023-11-24T06:11:09.728 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T06:11:09.838 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T06:11:10.078 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T06:11:10.385 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction check 2023-11-24T06:11:10.492 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T06:11:10.504 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction check succeeded. 2023-11-24T06:11:10.504 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction test 2023-11-24T06:11:10.728 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:11:11.129 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:11:11.344 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:11:11.458 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:11:11.620 INFO:teuthology.orchestra.run.smithi176.stdout:Transaction test succeeded. 2023-11-24T06:11:11.624 INFO:teuthology.orchestra.run.smithi176.stdout:Running transaction 2023-11-24T06:11:11.644 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:11:11.751 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:11:11.945 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T06:11:12.223 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-24T06:11:12.422 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-24T06:11:12.824 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-24T06:11:13.059 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-24T06:11:13.269 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T06:11:13.377 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T06:11:13.578 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T06:11:13.658 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T06:11:13.786 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T06:11:13.932 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T06:11:14.077 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T06:11:14.688 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T06:11:14.836 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T06:11:15.699 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T06:11:15.902 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T06:11:16.590 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T06:11:16.866 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-24T06:11:16.897 INFO:teuthology.orchestra.run.smithi176.stdout: Preparing : 1/1 2023-11-24T06:11:17.073 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-11-24T06:11:17.119 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-24T06:11:17.226 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-11-24T06:11:17.347 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-24T06:11:17.464 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-11-24T06:11:17.516 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-24T06:11:17.617 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T06:11:17.740 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-24T06:11:17.769 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-11-24T06:11:17.957 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-24T06:11:17.967 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T06:11:18.150 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 26/134 2023-11-24T06:11:18.271 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 27/134 2023-11-24T06:11:18.374 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-11-24T06:11:18.608 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:11:19.001 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:11:19.191 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:11:19.228 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 28/134 2023-11-24T06:11:19.344 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:11:19.524 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:11:19.548 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-24T06:11:19.619 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:11:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-24T06:11:19.825 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T06:11:20.086 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-24T06:11:20.197 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-11-24T06:11:20.268 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T06:11:20.587 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-11-24T06:11:20.987 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-11-24T06:11:21.273 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-11-24T06:11:21.441 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T06:11:21.545 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 14/134 2023-11-24T06:11:21.732 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T06:11:21.814 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 15/134 2023-11-24T06:11:21.949 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T06:11:22.019 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T06:11:22.118 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-11-24T06:11:22.240 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T06:11:22.344 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-24T06:11:22.555 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-24T06:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-24T06:11:22.853 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-11-24T06:11:22.965 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 36/134 2023-11-24T06:11:22.991 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T06:11:23.130 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 37/134 2023-11-24T06:11:23.346 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-24T06:11:23.494 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-24T06:11:23.586 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-11-24T06:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-24T06:11:23.757 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T06:11:23.838 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-24T06:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-24T06:11:24.256 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-24T06:11:24.461 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-11-24T06:11:24.639 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-24T06:11:24.724 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-11-24T06:11:24.962 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-24T06:11:24.974 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-11-24T06:11:25.160 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-11-24T06:11:25.161 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-24T06:11:25.337 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-11-24T06:11:25.396 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-24T06:11:25.512 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-11-24T06:11:25.781 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-24T06:11:25.940 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-11-24T06:11:26.122 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 26/134 2023-11-24T06:11:26.235 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 27/134 2023-11-24T06:11:26.261 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-24T06:11:26.508 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-24T06:11:26.735 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-24T06:11:26.966 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-24T06:11:27.140 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 28/134 2023-11-24T06:11:27.175 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-24T06:11:27.379 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-24T06:11:27.453 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-11-24T06:11:27.730 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-24T06:11:27.732 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-11-24T06:11:28.017 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-11-24T06:11:28.023 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-24T06:11:28.181 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T06:11:28.230 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-24T06:11:28.457 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-24T06:11:28.657 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-24T06:11:28.826 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-24T06:11:29.067 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T06:11:29.141 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T06:11:29.358 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-24T06:11:29.557 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-24T06:11:29.742 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T06:11:29.828 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T06:11:29.931 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-11-24T06:11:30.039 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-24T06:11:30.215 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-11-24T06:11:30.243 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-24T06:11:30.409 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-24T06:11:30.442 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-11-24T06:11:30.630 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-24T06:11:30.633 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-11-24T06:11:30.836 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 36/134 2023-11-24T06:11:30.947 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-24T06:11:30.976 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 37/134 2023-11-24T06:11:31.148 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-11-24T06:11:31.174 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-24T06:11:31.349 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-11-24T06:11:31.363 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-24T06:11:31.520 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-24T06:11:31.566 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-11-24T06:11:31.701 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-11-24T06:11:31.734 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-24T06:11:31.886 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-11-24T06:11:31.920 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-24T06:11:32.086 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-11-24T06:11:32.136 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-24T06:11:32.286 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-24T06:11:32.448 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-24T06:11:32.469 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-11-24T06:11:32.645 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-24T06:11:32.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-11-24T06:11:32.861 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-24T06:11:32.949 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-11-24T06:11:33.056 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-24T06:11:33.194 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-11-24T06:11:33.328 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-24T06:11:33.410 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-11-24T06:11:33.599 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-24T06:11:33.747 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-11-24T06:11:33.790 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-24T06:11:34.013 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-11-24T06:11:34.045 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-24T06:11:34.204 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-11-24T06:11:34.438 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-11-24T06:11:34.579 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-11-24T06:11:34.751 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-11-24T06:11:35.073 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-11-24T06:11:35.135 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-24T06:11:35.319 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-11-24T06:11:35.370 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-24T06:11:35.576 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-11-24T06:11:35.616 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-24T06:11:35.778 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-11-24T06:11:35.951 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-24T06:11:35.962 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-11-24T06:11:36.090 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-11-24T06:11:36.248 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-24T06:11:36.296 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T06:11:36.351 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-11-24T06:11:36.471 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-24T06:11:36.568 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-11-24T06:11:36.775 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-11-24T06:11:36.930 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T06:11:37.005 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-11-24T06:11:37.226 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-11-24T06:11:37.297 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-24T06:11:37.381 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-11-24T06:11:37.457 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T06:11:37.539 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T06:11:37.571 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-11-24T06:11:37.741 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-11-24T06:11:37.758 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 93/134 2023-11-24T06:11:38.026 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-11-24T06:11:38.228 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-11-24T06:11:38.401 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-11-24T06:11:38.541 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-11-24T06:11:38.757 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-11-24T06:11:38.951 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-11-24T06:11:39.150 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-11-24T06:11:39.291 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-11-24T06:11:39.428 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-11-24T06:11:39.652 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-11-24T06:11:39.890 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-11-24T06:11:40.085 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-11-24T06:11:40.318 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-11-24T06:11:40.545 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-11-24T06:11:40.737 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-11-24T06:11:40.927 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-11-24T06:11:41.381 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:42.025 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-11-24T06:11:42.132 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:42.316 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-11-24T06:11:42.536 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-11-24T06:11:42.724 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:42.836 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-11-24T06:11:43.029 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T06:11:43.098 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T06:11:43.102 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-11-24T06:11:43.274 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T06:11:43.284 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-11-24T06:11:44.143 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-11-24T06:11:44.337 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T06:11:44.419 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 92/134 2023-11-24T06:11:44.588 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 93/134 2023-11-24T06:11:48.281 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:48.487 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:49.059 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 94/134 2023-11-24T06:11:49.393 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T06:11:49.464 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 95/134 2023-11-24T06:11:49.603 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T06:12:02.312 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /sys 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /proc 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /run 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /mnt 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /var/tmp 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /home 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /tmp 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout:skipping the directory /dev 2023-11-24T06:12:02.313 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T06:12:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T06:12:04.477 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T06:12:04.707 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T06:12:04.888 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T06:12:05.343 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T06:12:05.571 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T06:12:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T06:12:07.471 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T06:12:07.670 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T06:12:07.777 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 102/134 2023-11-24T06:12:07.995 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 103/134 2023-11-24T06:12:08.162 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T06:12:08.383 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T06:12:08.422 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 96/134 2023-11-24T06:12:08.422 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /sys 2023-11-24T06:12:08.422 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /proc 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /dev 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /run 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /mnt 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /var/tmp 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /home 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /tmp 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout:skipping the directory /dev 2023-11-24T06:12:08.423 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:08.701 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T06:12:08.783 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T06:12:09.658 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T06:12:09.828 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T06:12:09.919 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T06:12:10.309 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 107/134 2023-11-24T06:12:10.382 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 97/134 2023-11-24T06:12:10.476 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T06:12:10.512 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T06:12:10.614 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T06:12:10.686 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T06:12:10.698 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T06:12:10.850 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 98/134 2023-11-24T06:12:11.041 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T06:12:11.496 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 99/134 2023-11-24T06:12:11.683 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T06:12:11.699 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 100/134 2023-11-24T06:12:12.008 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 110/134 2023-11-24T06:12:12.211 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T06:12:12.246 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T06:12:12.420 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T06:12:12.462 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T06:12:12.612 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T06:12:12.970 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T06:12:13.161 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T06:12:13.457 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T06:12:13.650 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 101/134 2023-11-24T06:12:13.789 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 102/134 2023-11-24T06:12:13.956 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 103/134 2023-11-24T06:12:14.157 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T06:12:14.375 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 104/134 2023-11-24T06:12:14.671 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T06:12:15.627 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 105/134 2023-11-24T06:12:15.798 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T06:12:15.888 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 106/134 2023-11-24T06:12:16.297 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 107/134 2023-11-24T06:12:16.495 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T06:12:16.531 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 108/134 2023-11-24T06:12:16.690 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T06:12:16.701 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 109/134 2023-11-24T06:12:17.818 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T06:12:18.009 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 110/134 2023-11-24T06:12:18.131 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 115/134 2023-11-24T06:12:18.249 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T06:12:18.282 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 111/134 2023-11-24T06:12:18.310 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T06:12:18.415 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T06:12:18.456 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 112/134 2023-11-24T06:12:18.510 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T06:12:18.590 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T06:12:18.948 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 113/134 2023-11-24T06:12:19.082 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T06:12:19.432 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-24T06:12:19.738 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-24T06:12:19.948 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 119/134 2023-11-24T06:12:20.181 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T06:12:20.331 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 121/134 2023-11-24T06:12:20.478 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T06:12:22.696 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:23.003 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:23.202 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 124/134 2023-11-24T06:12:23.501 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 125/134 2023-11-24T06:12:23.745 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 114/134 2023-11-24T06:12:23.784 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 126/134 2023-11-24T06:12:24.076 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 115/134 2023-11-24T06:12:24.136 INFO:teuthology.orchestra.run.smithi106.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-24T06:12:24.230 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T06:12:24.301 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:24.310 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:24.429 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-11-24T06:12:24.503 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-24T06:12:24.709 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T06:12:24.797 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T06:12:25.018 INFO:teuthology.orchestra.run.smithi106.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T06:12:25.032 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T06:12:25.032 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:25.246 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:25.246 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T06:12:25.295 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-11-24T06:12:25.507 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T06:12:25.634 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-11-24T06:12:25.700 INFO:teuthology.orchestra.run.smithi106.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:25.798 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 119/134 2023-11-24T06:12:26.017 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T06:12:26.168 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 121/134 2023-11-24T06:12:26.251 INFO:teuthology.orchestra.run.smithi106.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:26.251 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 1/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 3/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 4/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:12:26.252 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 10/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 11/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 12/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 13/134 2023-11-24T06:12:26.253 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 14/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 15/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 16/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 17/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 18/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 19/134 2023-11-24T06:12:26.254 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 21/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 22/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 23/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 24/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 25/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 26/134 2023-11-24T06:12:26.255 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 27/134 2023-11-24T06:12:26.256 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 28/134 2023-11-24T06:12:26.256 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/134 2023-11-24T06:12:26.256 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 30/134 2023-11-24T06:12:26.267 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 31/134 2023-11-24T06:12:26.267 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 34/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 36/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 37/134 2023-11-24T06:12:26.268 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 38/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-24T06:12:26.269 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-24T06:12:26.270 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-24T06:12:26.271 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-24T06:12:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-24T06:12:26.273 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-24T06:12:26.274 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-24T06:12:26.275 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-24T06:12:26.276 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-24T06:12:26.277 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-24T06:12:26.278 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-24T06:12:26.279 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-24T06:12:26.280 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-24T06:12:26.281 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 129/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 131/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:26.282 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-24T06:12:26.290 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T06:12:28.541 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:28.813 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:28.831 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-11-24T06:12:28.987 INFO:teuthology.orchestra.run.smithi106.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:28.987 INFO:teuthology.orchestra.run.smithi106.stdout:Last metadata expiration check: 0:01:52 ago on Fri 24 Nov 2023 06:10:36 AM UTC. 2023-11-24T06:12:28.988 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 124/134 2023-11-24T06:12:29.296 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 125/134 2023-11-24T06:12:29.611 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 126/134 2023-11-24T06:12:29.956 INFO:teuthology.orchestra.run.smithi176.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-11-24T06:12:30.096 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:30.104 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:30.246 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-11-24T06:12:30.446 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T06:12:30.531 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-11-24T06:12:30.771 INFO:teuthology.orchestra.run.smithi176.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T06:12:30.784 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-11-24T06:12:30.784 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:30.949 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:30.949 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T06:12:31.201 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-11-24T06:12:31.394 INFO:teuthology.orchestra.run.smithi176.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:31.729 INFO:teuthology.orchestra.run.smithi106.stdout:Installed products updated. 2023-11-24T06:12:31.909 INFO:teuthology.orchestra.run.smithi176.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:31.909 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 1/134 2023-11-24T06:12:31.909 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2/134 2023-11-24T06:12:31.909 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 3/134 2023-11-24T06:12:31.909 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 4/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7484.ga13ea 5/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 6/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 7/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 8/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 9/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 10/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 11/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 12/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 13/134 2023-11-24T06:12:31.910 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_ 14/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 15/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 16/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_6 17/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86 18/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 19/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el 20/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8. 21/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_6 22/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 23/134 2023-11-24T06:12:31.911 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 24/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 25/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 26/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 27/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 28/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff. 29/134 2023-11-24T06:12:31.912 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noa 30/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.n 31/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13 32/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el 33/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 34/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.e 35/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 36/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 37/134 2023-11-24T06:12:31.921 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 38/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-11-24T06:12:31.922 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-11-24T06:12:31.923 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-11-24T06:12:31.924 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-11-24T06:12:31.925 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-11-24T06:12:31.926 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-11-24T06:12:31.927 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-11-24T06:12:31.928 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 129/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 131/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-11-24T06:12:31.929 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout:Upgraded: 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout:Installed: 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-24T06:12:31.968 INFO:teuthology.orchestra.run.smithi106.stdout: automake-1.16.1-7.el8.noarch 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: bison-3.0.4-10.el8.x86_64 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.969 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.970 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:31.971 INFO:teuthology.orchestra.run.smithi106.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: flex-2.6.1-9.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: jq-1.6-3.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-24T06:12:31.972 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libpq-13.5-1.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-24T06:12:31.973 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-24T06:12:31.974 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.975 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-24T06:12:31.976 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-24T06:12:31.977 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-portend-2.6-1.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-24T06:12:31.978 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-24T06:12:31.979 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-24T06:12:31.980 INFO:teuthology.orchestra.run.smithi106.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:31.981 INFO:teuthology.orchestra.run.smithi106.stdout:Complete! 2023-11-24T06:12:32.187 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:34.652 INFO:teuthology.orchestra.run.smithi176.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-11-24T06:12:34.652 INFO:teuthology.orchestra.run.smithi176.stdout:Last metadata expiration check: 0:01:49 ago on Fri 24 Nov 2023 06:10:45 AM UTC. 2023-11-24T06:12:37.314 INFO:teuthology.orchestra.run.smithi176.stdout:Installed products updated. 2023-11-24T06:12:37.542 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout:Upgraded: 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: librados2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: librbd1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout:Installed: 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: automake-1.16.1-7.el8.noarch 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: bison-3.0.4-10.el8.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-base-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.543 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-grafana-dashboards-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-immutable-object-cache-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mds-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-dashboard-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-modules-core-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mgr-rook-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-mon-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.544 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-osd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-prometheus-alerts-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-radosgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-selinux-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-test-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: ceph-volume-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: cephadm-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: cephfs-top-2:18.0.0-7484.ga13ea5ff.el8.noarch 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: flex-2.6.1-9.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: fuse-2.9.7-15.el8.x86_64 2023-11-24T06:12:37.545 INFO:teuthology.orchestra.run.smithi176.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: jq-1.6-3.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libcephfs2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libcephsqlite-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: liboath-2.6.2-3.el8.x86_64 2023-11-24T06:12:37.546 INFO:teuthology.orchestra.run.smithi176.stdout: libpq-13.5-1.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: librados-devel-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libradosstriper1-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: librgw2-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libtool-2.4.6-25.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libunwind-1.3.1-3.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-11-24T06:12:37.547 INFO:teuthology.orchestra.run.smithi176.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-0.3.15-3.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:37.548 INFO:teuthology.orchestra.run.smithi176.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-babel-2.5.1-7.el8.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-argparse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-ceph-common-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cephfs-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-11-24T06:12:37.549 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-6.2-6.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-mako-1.0.6-13.el8.noarch 2023-11-24T06:12:37.550 INFO:teuthology.orchestra.run.smithi176.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-portend-2.6-1.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-11-24T06:12:37.551 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pycparser-2.14-14.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-pytz-2017.2-9.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rados-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rgw-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-routes-2.4.1-12.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-rsa-4.9-2.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-11-24T06:12:37.552 INFO:teuthology.orchestra.run.smithi176.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-fuse-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-mirror-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: rbd-nbd-2:18.0.0-7484.ga13ea5ff.el8.x86_64 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: socat-1.7.4.1-1.el8.x86_64 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: thrift-0.13.0-2.el8.x86_64 2023-11-24T06:12:37.553 INFO:teuthology.orchestra.run.smithi176.stdout: uuid-1.6.2-43.el8.x86_64 2023-11-24T06:12:37.554 INFO:teuthology.orchestra.run.smithi176.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-11-24T06:12:37.554 INFO:teuthology.orchestra.run.smithi176.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-11-24T06:12:37.554 INFO:teuthology.orchestra.run.smithi176.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-11-24T06:12:37.554 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:37.554 INFO:teuthology.orchestra.run.smithi176.stdout:Complete! 2023-11-24T06:12:37.726 DEBUG:teuthology.parallel:result is None 2023-11-24T06:12:37.729 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:12:37.869 DEBUG:teuthology.orchestra.run.smithi106:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:12:37.898 INFO:teuthology.orchestra.run.smithi106.stdout:18.0.0-7484.ga13ea5ff.el8 2023-11-24T06:12:37.898 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el8 2023-11-24T06:12:37.898 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:12:37.899 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a13ea5ff00cb4df7a9cc941166ddeb358881144c 2023-11-24T06:12:38.172 DEBUG:teuthology.orchestra.run.smithi176:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-11-24T06:12:38.196 INFO:teuthology.orchestra.run.smithi176.stdout:18.0.0-7484.ga13ea5ff.el8 2023-11-24T06:12:38.197 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7484.ga13ea5ff.el8 2023-11-24T06:12:38.197 INFO:teuthology.task.install:The correct ceph version 18.0.0-7484.ga13ea5ff is installed. 2023-11-24T06:12:38.197 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-24T06:12:38.197 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:38.197 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:12:38.245 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:38.245 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-24T06:12:38.285 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-24T06:12:38.286 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:38.286 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:12:38.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:12:38.383 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:38.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/daemon-helper 2023-11-24T06:12:38.410 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-24T06:12:38.476 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-24T06:12:38.477 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:38.477 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:12:38.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:12:38.570 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:38.570 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-24T06:12:38.596 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-24T06:12:38.661 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-24T06:12:38.661 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:38.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:12:38.687 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:12:38.797 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:38.798 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/usr/bin/stdin-killer 2023-11-24T06:12:38.824 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-24T06:12:38.889 INFO:teuthology.run_tasks:Running task ceph... 2023-11-24T06:12:38.953 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-24T06:12:38.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2023-11-24T06:12:38.957 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 777 /var/log/ceph 2023-11-24T06:12:38.983 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-24T06:12:38.984 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:12:39.025 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-24T06:12:39.051 INFO:tasks.ceph:Creating extra log directories... 2023-11-24T06:12:39.051 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:12:39.093 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-24T06:12:39.127 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-24T06:12:39.128 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-24T06:12:39.128 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-24T06:12:39.128 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:39.128 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:12:39.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:39.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:39.352 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:39.352 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-24T06:12:39.368 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:39.498 DEBUG:teuthology.orchestra.run.smithi176:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-11-24T06:12:39.529 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-24T06:12:39.529 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-24T06:12:39.530 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553', 'branch': 'rishabh-mgr-vol-misc', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}', 'email': None, 'first_in_suite': False, 'job_id': '7465553', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'rishabh-mgr-vol-misc'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-mgr-vol-misc', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3305, 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'sleep_before_teardown': 0, 'suite': 'fs:volumes', 'suite_branch': 'rishabh-mgr-vol-misc', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi176.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': 'a13ea5ff00cb4df7a9cc941166ddeb358881144c', 'cluster': 'ceph'}}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '2442239d2653456406c25ae0c71b689c8f2657b6', 'timestamp': '2023-11-24_05:41:33', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-24T06:12:39.530 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:12:39.533 DEBUG:teuthology.orchestra.run.smithi176:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-24T06:12:39.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:12:39.589 DEBUG:teuthology.orchestra.run.smithi176:> sudo install -d -m0777 -- /var/run/ceph 2023-11-24T06:12:39.647 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:39.647 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:12:39.670 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:12:39.670 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 384904 Links: 1 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-24 06:12:25.954385954 +0000 2023-11-24T06:12:39.728 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-24 06:09:48.716773014 +0000 2023-11-24T06:12:39.729 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-24 06:09:48.716773014 +0000 2023-11-24T06:12:39.729 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-24T06:12:39.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:12:39.792 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-24T06:12:39.792 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-24T06:12:39.792 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.00022536 s, 2.3 MB/s 2023-11-24T06:12:39.793 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:12:39.850 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 392550 Links: 1 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-24 06:12:25.954385954 +0000 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-24 06:09:49.220760671 +0000 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-24 06:09:49.220760671 +0000 2023-11-24T06:12:39.907 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-24T06:12:39.908 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:12:39.972 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-24T06:12:39.972 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-24T06:12:39.972 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000235952 s, 2.2 MB/s 2023-11-24T06:12:39.973 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:12:40.030 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2023-11-24T06:12:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:12:40.087 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:40.087 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 388558 Links: 1 2023-11-24T06:12:40.087 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:40.088 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:40.088 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-24 06:12:25.954385954 +0000 2023-11-24T06:12:40.088 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-24 06:09:49.733748108 +0000 2023-11-24T06:12:40.088 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-24 06:09:49.733748108 +0000 2023-11-24T06:12:40.088 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-24T06:12:40.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:12:40.152 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-24T06:12:40.152 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-24T06:12:40.152 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000219365 s, 2.3 MB/s 2023-11-24T06:12:40.153 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:12:40.211 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2023-11-24T06:12:40.268 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:12:40.268 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:40.268 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 385827 Links: 1 2023-11-24T06:12:40.268 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:40.268 INFO:teuthology.orchestra.run.smithi106.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:40.269 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2023-11-24 06:12:25.954385954 +0000 2023-11-24T06:12:40.269 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2023-11-24 06:09:50.226736034 +0000 2023-11-24T06:12:40.269 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2023-11-24 06:09:50.226736034 +0000 2023-11-24T06:12:40.269 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2023-11-24T06:12:40.269 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:12:40.334 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2023-11-24T06:12:40.334 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2023-11-24T06:12:40.334 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000205485 s, 2.5 MB/s 2023-11-24T06:12:40.335 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:12:40.393 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:40.393 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:40.393 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/scratch_devs of=/dev/stdout 2023-11-24T06:12:40.413 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-24T06:12:40.414 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_1 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 389096 Links: 1 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-24 06:12:31.607025644 +0000 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-24 06:09:48.729274973 +0000 2023-11-24T06:12:40.473 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-24 06:09:48.729274973 +0000 2023-11-24T06:12:40.474 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-24T06:12:40.474 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-24T06:12:40.542 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-24T06:12:40.542 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-24T06:12:40.542 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000271532 s, 1.9 MB/s 2023-11-24T06:12:40.544 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-24T06:12:40.604 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_2 2023-11-24T06:12:40.662 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 393610 Links: 1 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-24 06:12:31.607025644 +0000 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-24 06:09:49.258270064 +0000 2023-11-24T06:12:40.663 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-24 06:09:49.258270064 +0000 2023-11-24T06:12:40.664 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-24T06:12:40.664 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-24T06:12:40.731 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-24T06:12:40.731 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-24T06:12:40.731 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000241638 s, 2.1 MB/s 2023-11-24T06:12:40.732 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-24T06:12:40.793 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_3 2023-11-24T06:12:40.853 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-24T06:12:40.853 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:40.853 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 393674 Links: 1 2023-11-24T06:12:40.853 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:40.853 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:40.854 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-24 06:12:31.607025644 +0000 2023-11-24T06:12:40.854 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-24 06:09:49.778265238 +0000 2023-11-24T06:12:40.854 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-24 06:09:49.778265238 +0000 2023-11-24T06:12:40.854 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-24T06:12:40.855 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-24T06:12:40.922 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-24T06:12:40.923 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-24T06:12:40.923 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.000244344 s, 2.1 MB/s 2023-11-24T06:12:40.924 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-24T06:12:40.984 DEBUG:teuthology.orchestra.run.smithi176:> stat /dev/vg_nvme/lv_4 2023-11-24T06:12:41.045 INFO:teuthology.orchestra.run.smithi176.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-24T06:12:41.045 INFO:teuthology.orchestra.run.smithi176.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-24T06:12:41.045 INFO:teuthology.orchestra.run.smithi176.stdout:Device: 6h/6d Inode: 387695 Links: 1 2023-11-24T06:12:41.045 INFO:teuthology.orchestra.run.smithi176.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-24T06:12:41.045 INFO:teuthology.orchestra.run.smithi176.stdout:Context: system_u:object_r:device_t:s0 2023-11-24T06:12:41.046 INFO:teuthology.orchestra.run.smithi176.stdout:Access: 2023-11-24 06:12:31.608025634 +0000 2023-11-24T06:12:41.046 INFO:teuthology.orchestra.run.smithi176.stdout:Modify: 2023-11-24 06:09:50.294260449 +0000 2023-11-24T06:12:41.046 INFO:teuthology.orchestra.run.smithi176.stdout:Change: 2023-11-24 06:09:50.294260449 +0000 2023-11-24T06:12:41.046 INFO:teuthology.orchestra.run.smithi176.stdout: Birth: - 2023-11-24T06:12:41.046 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-24T06:12:41.115 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records in 2023-11-24T06:12:41.115 INFO:teuthology.orchestra.run.smithi176.stderr:1+0 records out 2023-11-24T06:12:41.115 INFO:teuthology.orchestra.run.smithi176.stderr:512 bytes copied, 0.00021135 s, 2.4 MB/s 2023-11-24T06:12:41.116 DEBUG:teuthology.orchestra.run.smithi176:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-24T06:12:41.177 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:41.177 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:12:41.178 INFO:tasks.ceph:Generating config... 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] debug client = 20 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] debug ms = 1 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] pid file = 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-24T06:12:41.179 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-24T06:12:41.179 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-24T06:12:41.179 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mgr] debug client = 20 2023-11-24T06:12:41.180 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-24T06:12:41.181 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-24T06:12:41.181 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-24T06:12:41.182 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-24T06:12:41.182 INFO:tasks.ceph:Setting up mon.a... 2023-11-24T06:12:41.183 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-24T06:12:41.239 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2023-11-24T06:12:41.242 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-24T06:12:41.288 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:12:41.314 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.106'), ('mon.b', '172.21.15.176'), ('mon.c', '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]')] 2023-11-24T06:12:41.315 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.106,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-24T06:12:41.316 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:41.316 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:12:41.372 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.106 --add b 172.21.15.176 --addv c '[v2:172.21.15.176:3301,v1:172.21.15.176:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid 2a42eb6f-5aad-4f8e-8067-d72b439cd81f 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = pacific 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 2a42eb6f-5aad-4f8e-8067-d72b439cd81f 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2023-11-24T06:12:41.457571+0000 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:created 2023-11-24T06:12:41.457571+0000 2023-11-24T06:12:41.459 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 16 (pacific) 2023-11-24T06:12:41.460 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2023-11-24T06:12:41.460 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2023-11-24T06:12:41.460 INFO:teuthology.orchestra.run.smithi106.stdout:1: [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] mon.b 2023-11-24T06:12:41.460 INFO:teuthology.orchestra.run.smithi106.stdout:2: [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] mon.c 2023-11-24T06:12:41.460 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-24T06:12:41.461 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-24T06:12:41.477 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2a42eb6f-5aad-4f8e-8067-d72b439cd81f... 2023-11-24T06:12:41.478 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:12:41.519 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.562 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:12:41.563 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:12:41.564 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2023-11-24T06:12:41.565 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.106,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on skipped message = False 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 2a42eb6f-5aad-4f8e-8067-d72b439cd81f 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2023-11-24T06:12:41.566 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2023-11-24T06:12:41.567 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2023-11-24T06:12:41.568 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.569 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: debug finisher = 20 2023-11-24T06:12:41.570 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.571 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:12:41.572 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2023-11-24T06:12:41.573 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2023-11-24T06:12:41.574 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2023-11-24T06:12:41.575 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout:[global] 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: chdir = "" 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: auth supported = cephx 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: filestore xattr use omap = true 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: mon clock drift allowed = 1.000 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: osd crush chooseleaf type = 0 2023-11-24T06:12:41.576 INFO:teuthology.orchestra.run.smithi176.stdout: auth debug = true 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on old message = true 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on bug = true 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: mon pg warn max object skew = 0 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: # disable pg_autoscaler by default for new pools 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default size = 2 2023-11-24T06:12:41.577 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow primary affinity = true 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd allow pg remap = true 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on legacy crush tunables = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on crush straw calc version zero = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on no sortbitwise = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on osd down out interval zero = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon warn on too few osds = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: mon_allow_pool_size_one = true 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-24T06:12:41.578 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: osd default data pool replay window = 5 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: mon allow pool delete = true 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: mon cluster log file level = debug 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: debug asserts on shutdown = true 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: mon health detail to clog = false 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: mon host = "172.21.15.106,172.21.15.176,[v2:172.21.15.176:3301,v1:172.21.15.176:6790]" 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: ms die on skipped message = False 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: fsid = 2a42eb6f-5aad-4f8e-8067-d72b439cd81f 2023-11-24T06:12:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout:[osd] 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout: osd journal size = 100 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub load threshold = 5.0 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout: osd scrub max interval = 600 2023-11-24T06:12:41.580 INFO:teuthology.orchestra.run.smithi176.stdout: osd mclock profile = high_recovery_ops 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: osd recover clone overlap = true 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: osd recovery max chunk = 1048576 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug shutdown = true 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug op order = true 2023-11-24T06:12:41.581 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug verify stray on activate = true 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug trim objects = true 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: osd open classes on start = true 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug pg log writeout = true 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: osd deep scrub update digest min age = 30 2023-11-24T06:12:41.582 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: osd map max advance = 10 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: journal zero on create = true 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: filestore ondisk finisher threads = 3 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: filestore apply finisher threads = 3 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.583 INFO:teuthology.orchestra.run.smithi176.stdout: bdev debug aio = true 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: osd debug misdirected ops = true 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: bdev async discard = True 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: bdev enable discard = True 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore allocator = bitmap 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore block size = 96636764160 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: bluestore fsck on mount = True 2023-11-24T06:12:41.584 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluefs = 1/20 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: debug bluestore = 1/20 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: debug osd = 20 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: debug rocksdb = 4/10 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd backfillfull_ratio = 0.85 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd full ratio = 0.9 2023-11-24T06:12:41.585 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd nearfull ratio = 0.8 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: osd failsafe full ratio = 0.95 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: osd objectstore = bluestore 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr] 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-24T06:12:41.586 INFO:teuthology.orchestra.run.smithi176.stdout: debug mgr = 20 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: mgr/telemetry/nag = false 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: debug finisher = 20 2023-11-24T06:12:41.587 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout:[mon] 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: debug mon = 20 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: debug paxos = 20 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: debug auth = 20 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: mon data avail warn = 5 2023-11-24T06:12:41.588 INFO:teuthology.orchestra.run.smithi176.stdout: mon mgr mkfs grace = 240 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min pgs per osd = 4 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd reporter subtree level = osd 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: mon osd prime pg temp = true 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: mon reweight min bytes per osd = 10 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: auth mon ticket ttl = 660 # 11m 2023-11-24T06:12:41.589 INFO:teuthology.orchestra.run.smithi176.stdout: auth service ticket ttl = 240 # 4m 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: # don't complain about insecure global_id in the test suite 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: # 1m isn't quite enough 2023-11-24T06:12:41.590 INFO:teuthology.orchestra.run.smithi176.stdout: mon_down_mkfs_grace = 2m 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout: mon_warn_on_filestore_osds = false 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout: mon op complaint time = 120 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout: 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout:[client] 2023-11-24T06:12:41.591 INFO:teuthology.orchestra.run.smithi176.stdout: rgw cache enabled = true 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable ops log = true 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: rgw enable usage log = true 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: client mount timeout = 600 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: debug client = 20 2023-11-24T06:12:41.592 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: pid file = "" 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.a] 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.b] 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout:[mon.c] 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-11-24T06:12:41.593 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout:[mds] 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds = 20 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout: debug mds balancer = 20 2023-11-24T06:12:41.594 INFO:teuthology.orchestra.run.smithi176.stdout: debug ms = 1 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug frag = True 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: mds debug scatterstat = True 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: mds op complaint time = 180 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: mds verify scatter = True 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: osd op complaint time = 180 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: rados mon op timeout = 900 2023-11-24T06:12:41.595 INFO:teuthology.orchestra.run.smithi176.stdout: rados osd op timeout = 900 2023-11-24T06:12:41.597 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-24T06:12:41.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-24T06:12:41.693 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-24T06:12:41.693 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:41.693 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-24T06:12:41.709 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:41.709 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-24T06:12:41.765 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:12:41.766 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:41.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:12:41.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:12:41.841 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:12:41.841 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:41.897 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:12:41.898 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:41.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-24T06:12:41.898 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-24T06:12:41.942 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:12:41.942 DEBUG:teuthology.orchestra.run.smithi176:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:42.000 INFO:tasks.ceph:Setting up mon nodes... 2023-11-24T06:12:42.000 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-24T06:12:42.000 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:12:42.053 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-24T06:12:42.056 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:12:42.137 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-24T06:12:42.140 INFO:tasks.ceph:Setting up mds nodes... 2023-11-24T06:12:42.140 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:12:42.194 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-24T06:12:42.196 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-24T06:12:42.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:12:42.315 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-24T06:12:42.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-24T06:12:42.343 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:12:42.402 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-24T06:12:42.405 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-24T06:12:42.432 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:12:42.527 INFO:teuthology.orchestra.run.smithi176.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-11-24T06:12:42.530 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-11-24T06:12:42.556 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-24T06:12:42.556 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-24T06:12:42.598 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-24T06:12:42.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-11-24T06:12:42.694 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-11-24T06:12:42.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-11-24T06:12:42.750 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-11-24T06:12:42.763 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-11-24T06:12:42.846 INFO:teuthology.orchestra.run.smithi176.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-11-24T06:12:42.859 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-24T06:12:42.859 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi176.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-24T06:12:42.859 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-24T06:12:42.886 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:42.886 INFO:tasks.ceph:role: osd.0 2023-11-24T06:12:42.886 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:12:42.886 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:42.960 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:42.961 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:42.961 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:42.961 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:43.397 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-24T06:12:43.399 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-24T06:12:43.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-24T06:12:43.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-24T06:12:43.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-24T06:12:43.670 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:43.671 INFO:tasks.ceph:role: osd.1 2023-11-24T06:12:43.671 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:12:43.671 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:12:43.743 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:44.182 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-24T06:12:44.184 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-24T06:12:44.184 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-24T06:12:44.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-24T06:12:44.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-24T06:12:44.391 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:44.391 INFO:tasks.ceph:role: osd.2 2023-11-24T06:12:44.391 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:12:44.391 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:44.465 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:44.912 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-24T06:12:44.914 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-24T06:12:44.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-24T06:12:45.090 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-24T06:12:45.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-24T06:12:45.195 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:45.195 INFO:tasks.ceph:role: osd.3 2023-11-24T06:12:45.195 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:12:45.196 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:45.271 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:45.272 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:45.272 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:45.272 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:45.707 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2023-11-24T06:12:45.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2023-11-24T06:12:45.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-24T06:12:45.877 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-24T06:12:45.914 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-24T06:12:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-24T06:12:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:12:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:12:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-24T06:12:46.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:46.089+0000 7fc23ae48640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-24T06:12:48.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-24T06:12:48.990 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:49.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.083+0000 7f25e53a4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-24T06:12:49.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.083+0000 7f25e53a4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-24T06:12:49.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.083+0000 7f25e53a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:12:49.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.083+0000 7f25e53a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:12:49.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.083+0000 7f25e53a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-24T06:12:49.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:49.084+0000 7f25e53a4640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-24T06:12:51.954 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-24T06:12:51.987 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.082+0000 7fb186526640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.082+0000 7fb186526640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.082+0000 7fb186526640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.082+0000 7fb186526640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.082+0000 7fb186526640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-24T06:12:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:52.083+0000 7fb186526640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-24T06:12:54.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-24T06:12:54.986 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:12:55.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.080+0000 7fde1db7c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-24T06:12:55.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.080+0000 7fde1db7c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-24T06:12:55.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.080+0000 7fde1db7c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:12:55.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.080+0000 7fde1db7c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:12:55.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.080+0000 7fde1db7c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-24T06:12:55.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:12:55.081+0000 7fde1db7c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-24T06:12:57.949 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-24T06:12:57.982 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-24T06:12:58.014 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:58.015 INFO:tasks.ceph:role: osd.4 2023-11-24T06:12:58.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:12:58.015 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-24T06:12:58.092 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:58.092 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:58.092 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:58.093 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:58.524 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-11-24T06:12:58.526 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-24T06:12:58.527 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-24T06:12:58.688 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-24T06:12:58.724 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-24T06:12:58.795 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:58.795 INFO:tasks.ceph:role: osd.5 2023-11-24T06:12:58.795 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:12:58.795 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-24T06:12:58.870 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:58.870 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:58.870 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:58.870 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:58.870 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:58.871 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:58.871 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:58.871 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:58.871 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:58.871 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:12:59.287 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-11-24T06:12:59.289 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-24T06:12:59.290 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-24T06:12:59.407 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-24T06:12:59.439 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-24T06:12:59.508 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:12:59.508 INFO:tasks.ceph:role: osd.6 2023-11-24T06:12:59.508 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:12:59.508 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-24T06:12:59.584 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:12:59.584 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:12:59.584 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:12:59.584 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:12:59.584 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:12:59.585 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:12:59.585 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:12:59.585 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:12:59.585 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:12:59.585 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:00.040 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-11-24T06:13:00.042 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-24T06:13:00.043 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-24T06:13:00.211 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-24T06:13:00.243 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-24T06:13:00.311 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-24T06:13:00.312 INFO:tasks.ceph:role: osd.7 2023-11-24T06:13:00.312 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:13:00.312 DEBUG:teuthology.orchestra.run.smithi176:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-24T06:13:00.386 INFO:teuthology.orchestra.run.smithi176.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout: = sunit=0 swidth=0 blks 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-24T06:13:00.387 INFO:teuthology.orchestra.run.smithi176.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-24T06:13:00.818 INFO:teuthology.orchestra.run.smithi176.stdout:Discarding blocks...Done. 2023-11-24T06:13:00.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi176.front.sepia.ceph.com -o noatime 2023-11-24T06:13:00.820 DEBUG:teuthology.orchestra.run.smithi176:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-24T06:13:00.989 DEBUG:teuthology.orchestra.run.smithi176:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-24T06:13:01.024 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:01.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.122+0000 7f12869b8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-24T06:13:01.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.123+0000 7f12869b8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-24T06:13:01.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.123+0000 7f12869b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:13:01.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.123+0000 7f12869b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:13:01.126 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.123+0000 7f12869b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-24T06:13:01.127 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:01.123+0000 7f12869b8640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-24T06:13:04.006 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-24T06:13:04.036 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:04.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.125+0000 7f1191dcb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-24T06:13:04.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.125+0000 7f1191dcb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-24T06:13:04.128 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.125+0000 7f1191dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:13:04.129 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.125+0000 7f1191dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:13:04.129 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.125+0000 7f1191dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-24T06:13:04.129 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:04.126+0000 7f1191dcb640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-24T06:13:06.998 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-24T06:13:07.029 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.117+0000 7f62dc2dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.118+0000 7f62dc2dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.118+0000 7f62dc2dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.118+0000 7f62dc2dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.118+0000 7f62dc2dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-24T06:13:07.121 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:07.118+0000 7f62dc2dc640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-24T06:13:09.532 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:09.534 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:09.983 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-24T06:13:10.014 DEBUG:teuthology.orchestra.run.smithi176:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:10.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.105+0000 7f8290be3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-24T06:13:10.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.106+0000 7f8290be3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-24T06:13:10.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.106+0000 7f8290be3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:13:10.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.106+0000 7f8290be3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:13:10.109 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.106+0000 7f8290be3640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-24T06:13:10.110 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:10.106+0000 7f8290be3640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-24T06:13:12.978 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-24T06:13:13.009 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-24T06:13:13.010 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-24T06:13:13.042 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.043 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-24T06:13:13.114 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.114 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-24T06:13:13.187 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-24T06:13:13.259 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.259 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-24T06:13:13.330 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.330 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-24T06:13:13.402 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.403 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-24T06:13:13.473 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.473 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-24T06:13:13.505 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.505 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-24T06:13:13.575 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.575 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-11-24T06:13:13.643 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.643 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-24T06:13:13.712 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.712 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-24T06:13:13.779 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.780 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-24T06:13:13.846 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.846 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-24T06:13:13.913 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.913 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-24T06:13:13.933 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:13.933 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-11-24T06:13:13.994 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:13.994 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-11-24T06:13:14.010 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:14.010 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-11-24T06:13:14.067 INFO:tasks.ceph:Adding keys to all mons... 2023-11-24T06:13:14.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:13:14.069 DEBUG:teuthology.orchestra.run.smithi176:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlgRcbAxAAlnlh3rugVA6TjApKAw+bIg== 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlt8t5CxAAsvvmmcQD7gLh9PEmcinoEA== 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBl1NO2EhAAh06zuJZauDPLQrKzwsc+ew== 2023-11-24T06:13:14.110 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDePmBlOlNdBRAA3H7OBSFohwL5UPHleUl5vw== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDhPmBlnOQJBRAAhaPa6HE8ThfnO/Ao8OOiUw== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDkPmBlbADzBBAAKTNN/gFKWZs+VvylbkiB3A== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDnPmBlfGPWBBAAdnF/Co8TQLowHlP6MPOliQ== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlaWsUCBAAsg3GesP5+XVbRRpO7U57Yw== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlhn3qFxAAfWFcELOaPQBOtNSrzPoabw== 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2023-11-24T06:13:14.111 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlrTFZHxAAGAV4/3mV7dqHWV92YVEfkw== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDtPmBl1nhnBxAA7Ms+mPk6u7pqldgKBscprg== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDwPmBljHCMBxAAfqqAbkAR78yC5j+PDMYY0Q== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDzPmBlB4oZBxAAz9PFkRRMtGrdcnBYv49dhw== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD2PmBldvxkBhAAoQ3K/6MWEA5XX5X+9o91WQ== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBl1j6aIxAAAR3xrON0w7ObmiN+s8p//g== 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout:[client.2] 2023-11-24T06:13:14.112 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlgkRKKRAAWymetPQcPFSHayaC1PK0Fw== 2023-11-24T06:13:14.113 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2023-11-24T06:13:14.113 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBlb3mhLBAAhqVrreYNSyUEzuIP+KQm6g== 2023-11-24T06:13:14.113 INFO:teuthology.orchestra.run.smithi106.stdout:[client.3] 2023-11-24T06:13:14.113 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBl5fBXMhAAJBt2jDg/VodHWrgU6bT5fA== 2023-11-24T06:13:14.131 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.y] 2023-11-24T06:13:14.131 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlgRcbAxAAlnlh3rugVA6TjApKAw+bIg== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.a] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlt8t5CxAAsvvmmcQD7gLh9PEmcinoEA== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.c] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBl1NO2EhAAh06zuJZauDPLQrKzwsc+ew== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.0] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDePmBlOlNdBRAA3H7OBSFohwL5UPHleUl5vw== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.1] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDhPmBlnOQJBRAAhaPa6HE8ThfnO/Ao8OOiUw== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.2] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDkPmBlbADzBBAAKTNN/gFKWZs+VvylbkiB3A== 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.3] 2023-11-24T06:13:14.132 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDnPmBlfGPWBBAAdnF/Co8TQLowHlP6MPOliQ== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[mgr.x] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlaWsUCBAAsg3GesP5+XVbRRpO7U57Yw== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.b] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlhn3qFxAAfWFcELOaPQBOtNSrzPoabw== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[mds.d] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlrTFZHxAAGAV4/3mV7dqHWV92YVEfkw== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.4] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDtPmBl1nhnBxAA7Ms+mPk6u7pqldgKBscprg== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.5] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDwPmBljHCMBxAAfqqAbkAR78yC5j+PDMYY0Q== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.6] 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDzPmBlB4oZBxAAz9PFkRRMtGrdcnBYv49dhw== 2023-11-24T06:13:14.133 INFO:teuthology.orchestra.run.smithi176.stdout:[osd.7] 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQD2PmBldvxkBhAAoQ3K/6MWEA5XX5X+9o91WQ== 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:[client.0] 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBl1j6aIxAAAR3xrON0w7ObmiN+s8p//g== 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:[client.2] 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlgkRKKRAAWymetPQcPFSHayaC1PK0Fw== 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:[client.1] 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBlb3mhLBAAhqVrreYNSyUEzuIP+KQm6g== 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout:[client.3] 2023-11-24T06:13:14.134 INFO:teuthology.orchestra.run.smithi176.stdout: key = AQDaPmBl5fBXMhAAJBt2jDg/VodHWrgU6bT5fA== 2023-11-24T06:13:14.135 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:13:14.156 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:13:14.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.230 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.297 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.361 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.364 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.427 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.484 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.537 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.539 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:13:14.594 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-24T06:13:14.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.649 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.707 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-24T06:13:14.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.765 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.820 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.873 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.875 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.930 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-24T06:13:14.983 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:14.985 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.042 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.044 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.100 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.102 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.158 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.161 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-24T06:13:15.217 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-24T06:13:15.217 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-24T06:13:15.243 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:13:15.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-24T06:13:15.367 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-24T06:13:15.393 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:13:15.492 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-24T06:13:15.518 DEBUG:teuthology.orchestra.run.smithi176:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-24T06:13:15.583 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-24T06:13:15.682 DEBUG:teuthology.orchestra.run.smithi176:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-24T06:13:15.709 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:15.711 DEBUG:teuthology.orchestra.run.smithi176:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-24T06:13:15.765 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-24T06:13:15.765 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-24T06:13:15.766 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-24T06:13:15.768 INFO:tasks.ceph.mon.a:Started 2023-11-24T06:13:15.768 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-24T06:13:15.768 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-24T06:13:15.808 INFO:tasks.ceph.mon.b:Started 2023-11-24T06:13:15.808 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-24T06:13:15.808 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-24T06:13:15.810 INFO:tasks.ceph.mon.c:Started 2023-11-24T06:13:15.810 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-24T06:13:15.810 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-24T06:13:15.810 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-24T06:13:15.812 INFO:tasks.ceph.mgr.y:Started 2023-11-24T06:13:15.813 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-24T06:13:15.813 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-24T06:13:15.815 INFO:tasks.ceph.mgr.x:Started 2023-11-24T06:13:15.815 INFO:tasks.ceph:Setting crush tunables to default 2023-11-24T06:13:15.815 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2023-11-24T06:13:15.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.934+0000 7f3499de3700 1 Processor -- start 2023-11-24T06:13:15.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.934+0000 7f3499de3700 1 -- start start 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3499de3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 0x7f349415b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3499de3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f34940b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3499de3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940ae5e0 con 0x7f34941587f0 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3499de3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34940b4630 con 0x7f349415b370 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3499de3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349415be30 con 0x7f34940b3c60 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f348bfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 0x7f349415b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f34937fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f34941587f0 0x7f349406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37316/0 (socket says 172.21.15.106:37316) 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f34937fe700 1 -- 172.21.15.106:0/23747477 learned_addr learned my addr 172.21.15.106:0/23747477 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f348bfff700 1 -- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 msgr2=0x7f349415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-24T06:13:15.939 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f348bfff700 1 -- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 msgr2=0x7f349415b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 0x7f349415b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 0x7f349415b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3493fff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f34940b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3493fff700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 msgr2=0x7f34940b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3493fff700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 msgr2=0x7f34940b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3493fff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f34940b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-24T06:13:15.940 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:15.935+0000 7f3493fff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f34940b40f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-24T06:13:16.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2356104578 0 0) 0x7f34940ae5e0 con 0x7f34941587f0 2023-11-24T06:13:16.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34800035b0 con 0x7f34941587f0 2023-11-24T06:13:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3369810330 0 0) 0x7f34800035b0 con 0x7f34941587f0 2023-11-24T06:13:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 msgr2=0x7f34940b40f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f34940b40f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 msgr2=0x7f349415b800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 --2- 172.21.15.106:0/23747477 >> v2:172.21.15.106:3300/0 conn(0x7f349415b370 0x7f349415b800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349415c110 con 0x7f34941587f0 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f3484001670 con 0x7f34941587f0 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 >> v1:172.21.15.106:6789/0 conn(0x7f34941587f0 legacy=0x7f349406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3480003a00 0x7f3480003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f3480004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.130+0000 7f3492ffd700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f3480005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940b4630 con 0x7f3480004850 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349415be30 con 0x7f3480003a00 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348000bac0 con 0x7f34940b3c60 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f3480004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f34937fe700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3480003a00 0x7f3480003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3493fff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f3480005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 msgr2=0x7f3480005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f34940b3c60 0x7f3480005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3480003a00 msgr2=0x7f3480003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3480003a00 0x7f3480003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 -- 172.21.15.106:0/23747477 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34800035b0 con 0x7f3480004850 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f348bfff700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f3480004cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f347c009860 tx=0x7f3480005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106b150b8abb579 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c00c070 con 0x7f3480004850 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c004020 con 0x7f3480004850 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.131+0000 7f3492ffd700 1 -- 172.21.15.106:0/23747477 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0043b0 con 0x7f3480004850 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 -- 172.21.15.106:0/23747477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 msgr2=0x7f3480004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 --2- 172.21.15.106:0/23747477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f3480004cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f347c009860 tx=0x7f3480005880 comp rx=0 tx=0).stop 2023-11-24T06:13:16.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3493fff700 1 -- 172.21.15.106:0/23747477 reap_dead start 2023-11-24T06:13:16.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 -- 172.21.15.106:0/23747477 shutdown_connections 2023-11-24T06:13:16.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 -- 172.21.15.106:0/23747477 >> 172.21.15.106:0/23747477 conn(0x7f34940d0bf0 msgr2=0x7f34940d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 -- 172.21.15.106:0/23747477 shutdown_connections 2023-11-24T06:13:16.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.132+0000 7f3499de3700 1 -- 172.21.15.106:0/23747477 wait complete. 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.133+0000 7f3499de3700 1 Processor -- start 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.133+0000 7f3499de3700 1 -- start start 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3494074200 0x7f349409d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3494074680 0x7f34941447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941461b0 con 0x7f3480004850 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c5d70 con 0x7f3494074200 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3499de3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3494145530 con 0x7f3494074680 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57076/0 (socket says 172.21.15.106:57076) 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 -- 172.21.15.106:0/546102560 learned_addr learned my addr 172.21.15.106:0/546102560 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f348bfff700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3494074200 0x7f349409d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f3493fff700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3494074680 0x7f34941447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 -- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3494074680 msgr2=0x7f34941447f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3494074680 0x7f34941447f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 -- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3494074200 msgr2=0x7f349409d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3494074200 0x7f349409d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.134+0000 7f34937fe700 1 -- 172.21.15.106:0/546102560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3494145810 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f34937fe700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34840072c0 tx=0x7f34840075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400f5e0 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348400f740 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3494145af0 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348400faf0 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3494153be0 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3484014450 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.135+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f348401f850 con 0x7f3480004850 2023-11-24T06:13:16.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.136+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3494068fb0 con 0x7f3480004850 2023-11-24T06:13:16.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.138+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f348401a070 con 0x7f3480004850 2023-11-24T06:13:16.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.218+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f34940b4040 con 0x7f3480004850 2023-11-24T06:13:16.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.220+0000 7f3490ff9700 1 -- 172.21.15.106:0/546102560 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f348401fac0 con 0x7f3480004850 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 msgr2=0x7f349409aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f34840072c0 tx=0x7f34840075d0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 shutdown_connections 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3494074680 0x7f34941447f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3480004850 0x7f349409aa00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 --2- 172.21.15.106:0/546102560 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3494074200 0x7f349409d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 >> 172.21.15.106:0/546102560 conn(0x7f34940d0bf0 msgr2=0x7f349415d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 shutdown_connections 2023-11-24T06:13:16.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:16.221+0000 7f3499de3700 1 -- 172.21.15.106:0/546102560 wait complete. 2023-11-24T06:13:16.225 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2023-11-24T06:13:16.235 INFO:tasks.ceph:check_enable_crimson: False 2023-11-24T06:13:16.236 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-24T06:13:16.236 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:16.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-24T06:13:16.252 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:16.249+0000 7f11028f5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:13:16.260 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:16.258+0000 7f10cc85f200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-24T06:13:16.261 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:16.261 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-24T06:13:16.317 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:16.314+0000 7f11028f5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:13:16.327 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:16.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-24T06:13:16.329 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:16.326+0000 7f10cc85f200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-24T06:13:16.353 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:16.353 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-24T06:13:16.393 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:16.391+0000 7f11028f5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:13:16.409 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:16.407+0000 7f10cc85f200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-24T06:13:16.419 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:16.419 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-24T06:13:16.445 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:16.445 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-24T06:13:16.478 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:16.471+0000 7f11028f5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:13:16.494 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:16.489+0000 7f10cc85f200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-24T06:13:16.508 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:16.508 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-24T06:13:16.573 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:13:16.573 DEBUG:teuthology.orchestra.run.smithi176:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-24T06:13:16.624 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:16.621+0000 7f11028f5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:13:16.635 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:16.633+0000 7f10cc85f200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-24T06:13:16.642 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 0da045f6-d4b5-4922-b1fc-776933661743 0 2023-11-24T06:13:16.803 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 Processor -- start 2023-11-24T06:13:16.803 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 -- start start 2023-11-24T06:13:16.805 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbf415e160 0x7fbbf40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.805 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbbf40afc90 0x7fbbf4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.805 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf40b3c60 con 0x7fbbf40744d0 2023-11-24T06:13:16.805 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf40b4500 con 0x7fbbf415e160 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.800+0000 7fbbfaa09700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf4074940 con 0x7fbbf40afc90 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbbf40afc90 0x7fbbf4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbbf40afc90 0x7fbbf4073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55838/0 (socket says 172.21.15.176:55838) 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 -- 172.21.15.176:0/3835419282 learned_addr learned my addr 172.21.15.176:0/3835419282 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf8fa6700 1 --1- 172.21.15.176:0/3835419282 >> v1:172.21.15.176:6789/0 conn(0x7fbbf40744d0 0x7fbbf406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:37856/0 (socket says 172.21.15.176:37856) 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf3fff700 1 --2- 172.21.15.176:0/3835419282 >> v2:172.21.15.106:3300/0 conn(0x7fbbf415e160 0x7fbbf40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 -- 172.21.15.176:0/3835419282 >> v2:172.21.15.106:3300/0 conn(0x7fbbf415e160 msgr2=0x7fbbf40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 --2- 172.21.15.176:0/3835419282 >> v2:172.21.15.106:3300/0 conn(0x7fbbf415e160 0x7fbbf40b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 -- 172.21.15.176:0/3835419282 >> v1:172.21.15.176:6789/0 conn(0x7fbbf40744d0 legacy=0x7fbbf406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 -- 172.21.15.176:0/3835419282 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40b58c0 con 0x7fbbf40afc90 2023-11-24T06:13:16.806 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf37fe700 1 --2- 172.21.15.176:0/3835419282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf40afc90 0x7fbbf4073f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40d0880 tx=0x7fbbe8009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e1ab70f7f668b92 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf2ffd700 1 -- 172.21.15.176:0/3835419282 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8011830 con 0x7fbbf40afc90 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf2ffd700 1 -- 172.21.15.176:0/3835419282 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe8011990 con 0x7fbbf40afc90 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.801+0000 7fbbf2ffd700 1 -- 172.21.15.176:0/3835419282 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8011d20 con 0x7fbbf40afc90 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 -- 172.21.15.176:0/3835419282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf40afc90 msgr2=0x7fbbf4073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/3835419282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf40afc90 0x7fbbf4073f90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40d0880 tx=0x7fbbe8009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 -- 172.21.15.176:0/3835419282 shutdown_connections 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/3835419282 >> v2:172.21.15.106:3300/0 conn(0x7fbbf415e160 0x7fbbf40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/3835419282 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf40afc90 0x7fbbf4073f90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 -- 172.21.15.176:0/3835419282 >> 172.21.15.176:0/3835419282 conn(0x7fbbf40d0bf0 msgr2=0x7fbbf40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 -- 172.21.15.176:0/3835419282 shutdown_connections 2023-11-24T06:13:16.807 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.802+0000 7fbbfaa09700 1 -- 172.21.15.176:0/3835419282 wait complete. 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.803+0000 7fbbfaa09700 1 Processor -- start 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 -- start start 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 0x7fbbf414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 0x7fbbf414a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:16.810 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf414b880 con 0x7fbbf40afc90 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf40c6ba0 con 0x7fbbf415e160 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.804+0000 7fbbfaa09700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf414af50 con 0x7fbbf40744d0 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf8fa6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 0x7fbbf414a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41702/0 (socket says 172.21.15.176:41702) 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 -- 172.21.15.176:0/2708812553 learned_addr learned my addr 172.21.15.176:0/2708812553 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:16.811 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf37fe700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 0x7fbbf414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 -- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 msgr2=0x7fbbf414a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 0x7fbbf414a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 -- 172.21.15.176:0/2708812553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 msgr2=0x7fbbf414a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 0x7fbbf414a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 -- 172.21.15.176:0/2708812553 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8009550 con 0x7fbbf40744d0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf37fe700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 0x7fbbf414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf8fa6700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 0x7fbbf414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf3fff700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400e870 tx=0x7fbbe400eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe4009590 con 0x7fbbf40744d0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe4013680 con 0x7fbbf40744d0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe40139f0 con 0x7fbbf40744d0 2023-11-24T06:13:16.812 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf414b230 con 0x7fbbf40744d0 2023-11-24T06:13:16.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf40c7800 con 0x7fbbf40744d0 2023-11-24T06:13:16.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbbe4005a20 con 0x7fbbf40744d0 2023-11-24T06:13:16.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.805+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbbe401c790 con 0x7fbbf40744d0 2023-11-24T06:13:16.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.806+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf40af7d0 con 0x7fbbf40744d0 2023-11-24T06:13:16.813 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.810+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbbe4021060 con 0x7fbbf40744d0 2023-11-24T06:13:16.898 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.895+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0da045f6-d4b5-4922-b1fc-776933661743", "id": 0} v 0) v1 -- 0x7fbbf4068fb0 con 0x7fbbf40744d0 2023-11-24T06:13:16.903 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.901+0000 7fbbf0ff9700 1 -- 172.21.15.176:0/2708812553 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0da045f6-d4b5-4922-b1fc-776933661743", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbbe4017070 con 0x7fbbf40744d0 2023-11-24T06:13:16.904 INFO:teuthology.orchestra.run.smithi176.stdout:0 2023-11-24T06:13:16.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 msgr2=0x7fbbf41620a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:16.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbe400e870 tx=0x7fbbe400eb80 comp rx=0 tx=0).stop 2023-11-24T06:13:16.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 shutdown_connections 2023-11-24T06:13:16.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbbf415e160 0x7fbbf414a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.905 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbbf40744d0 0x7fbbf41620a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 --2- 172.21.15.176:0/2708812553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbf40afc90 0x7fbbf414a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:16.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 >> 172.21.15.176:0/2708812553 conn(0x7fbbf40d0bf0 msgr2=0x7fbbf40add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:16.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 shutdown_connections 2023-11-24T06:13:16.906 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:16.902+0000 7fbbfaa09700 1 -- 172.21.15.176:0/2708812553 wait complete. 2023-11-24T06:13:16.916 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 7cc5fa44-1fe2-408e-ab8f-c2a4c515b028 1 2023-11-24T06:13:17.025 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:17.023+0000 7f10cc85f200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:13:17.029 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:17.027+0000 7f11028f5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-24T06:13:17.037 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.034+0000 7f77d843b700 1 Processor -- start 2023-11-24T06:13:17.037 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.034+0000 7f77d843b700 1 -- start start 2023-11-24T06:13:17.039 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d843b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.039 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d843b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d015bf70 con 0x7f77d00af520 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d843b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d015ee00 con 0x7f77d00744d0 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d843b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d0074980 con 0x7f77d00b4020 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d59d6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d69d8700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f77d00744d0 0x7f77d006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:37868/0 (socket says 172.21.15.176:37868) 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d69d8700 1 -- 172.21.15.176:0/2935143184 learned_addr learned my addr 172.21.15.176:0/2935143184 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734911999 0 0) 0x7f77d015ee00 con 0x7f77d00744d0 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77bc0035b0 con 0x7f77d00744d0 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245024112 0 0) 0x7f77cc001110 con 0x7f77d00af520 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d59d6700 1 -- 172.21.15.176:0/2935143184 >> v1:172.21.15.176:6789/0 conn(0x7f77d00744d0 legacy=0x7f77d006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.040 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d59d6700 1 -- 172.21.15.176:0/2935143184 >> v1:172.21.15.106:6789/0 conn(0x7f77d00af520 legacy=0x7f77d00afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d59d6700 1 -- 172.21.15.176:0/2935143184 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d00b0240 con 0x7f77d00b4020 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d59d6700 1 --2- 172.21.15.176:0/2935143184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0073f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009870 tx=0x7f77c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5062cf57ccd6657 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.035+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0011830 con 0x7f77d00b4020 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c0011990 con 0x7f77d00b4020 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d51d5700 1 -- 172.21.15.176:0/2935143184 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0011d20 con 0x7f77d00b4020 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 -- 172.21.15.176:0/2935143184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 msgr2=0x7f77d0073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 --2- 172.21.15.176:0/2935143184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0073f90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f77c0009870 tx=0x7f77c0009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 -- 172.21.15.176:0/2935143184 shutdown_connections 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 --2- 172.21.15.176:0/2935143184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0073f90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 -- 172.21.15.176:0/2935143184 >> 172.21.15.176:0/2935143184 conn(0x7f77d00b28f0 msgr2=0x7f77d00b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 -- 172.21.15.176:0/2935143184 shutdown_connections 2023-11-24T06:13:17.041 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.036+0000 7f77d843b700 1 -- 172.21.15.176:0/2935143184 wait complete. 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 Processor -- start 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 -- start start 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 0x7f77d0146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d00af520 0x7f77d0158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d01606a0 con 0x7f77d00744d0 2023-11-24T06:13:17.044 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d006c460 con 0x7f77d00af520 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d843b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d015c2b0 con 0x7f77d00b4020 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d69d8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d69d8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41718/0 (socket says 172.21.15.176:41718) 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d69d8700 1 -- 172.21.15.176:0/1478324900 learned_addr learned my addr 172.21.15.176:0/1478324900 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d61d7700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 0x7f77d0146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.038+0000 7f77d59d6700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d00af520 0x7f77d0158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 -- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d00af520 msgr2=0x7f77d0158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d00af520 0x7f77d0158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 -- 172.21.15.176:0/1478324900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 msgr2=0x7f77d0146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 0x7f77d0146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 -- 172.21.15.176:0/1478324900 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c00094a0 con 0x7f77d00b4020 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d61d7700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 0x7f77d0146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:17.045 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d69d8700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77c800caa0 tx=0x7f77c800cdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c800a9e0 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c800ab40 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d015c590 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c8012400 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d015cb50 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77c8012560 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.039+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f77c801ca70 con 0x7f77d00b4020 2023-11-24T06:13:17.046 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.040+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d0068fb0 con 0x7f77d00b4020 2023-11-24T06:13:17.047 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.042+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f77c8017070 con 0x7f77d00b4020 2023-11-24T06:13:17.132 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.129+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7cc5fa44-1fe2-408e-ab8f-c2a4c515b028", "id": 1} v 0) v1 -- 0x7f77d00b4ed0 con 0x7f77d00b4020 2023-11-24T06:13:17.137 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.135+0000 7f77c6ffd700 1 -- 172.21.15.176:0/1478324900 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7cc5fa44-1fe2-408e-ab8f-c2a4c515b028", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77c8012a40 con 0x7f77d00b4020 2023-11-24T06:13:17.138 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 msgr2=0x7f77d0159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77c800caa0 tx=0x7f77c800cdb0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 shutdown_connections 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f77d00b4020 0x7f77d0159080 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77d00744d0 0x7f77d0146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 --2- 172.21.15.176:0/1478324900 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f77d00af520 0x7f77d0158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 >> 172.21.15.176:0/1478324900 conn(0x7f77d00b28f0 msgr2=0x7f77d00add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.139 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 shutdown_connections 2023-11-24T06:13:17.140 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.136+0000 7f77d843b700 1 -- 172.21.15.176:0/1478324900 wait complete. 2023-11-24T06:13:17.142 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:17.139+0000 7f10cc85f200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:13:17.150 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 5a59b21c-afed-4eff-afeb-184886fbb6fd 2 2023-11-24T06:13:17.153 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:17.151+0000 7f11028f5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-24T06:13:17.229 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:17.226+0000 7f10cc85f200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:13:17.241 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:17.238+0000 7f11028f5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-24T06:13:17.271 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.268+0000 7f506ffa6700 1 Processor -- start 2023-11-24T06:13:17.271 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.268+0000 7f506ffa6700 1 -- start start 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.269+0000 7f506ffa6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f506815bf50 0x7f50680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.269+0000 7f506ffa6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.269+0000 7f506ffa6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50680d0140 con 0x7f50680cf1f0 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.269+0000 7f506ffa6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506815c330 con 0x7f506815bf50 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.269+0000 7f506ffa6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50680d03e0 con 0x7f50680ce830 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506d541700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506d541700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55862/0 (socket says 172.21.15.176:55862) 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f506815bf50 0x7f50680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506d541700 1 -- 172.21.15.176:0/2478762596 learned_addr learned my addr 172.21.15.176:0/2478762596 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 -- 172.21.15.176:0/2478762596 >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 msgr2=0x7f50680cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 --2- 172.21.15.176:0/2478762596 >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 -- 172.21.15.176:0/2478762596 >> v1:172.21.15.106:6789/0 conn(0x7f50680cf1f0 legacy=0x7f50680c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 -- 172.21.15.176:0/2478762596 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680d06c0 con 0x7f506815bf50 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506cd40700 1 -- 172.21.15.176:0/2478762596 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128069267 0 0) 0x7f50680d0140 con 0x7f50680cf1f0 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506d541700 1 --2- 172.21.15.176:0/2478762596 >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506dd42700 1 --2- 172.21.15.176:0/2478762596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f50680ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5068072420 tx=0x7f5064009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c4a9f035d0a41c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506cd40700 1 -- 172.21.15.176:0/2478762596 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011830 con 0x7f506815bf50 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506cd40700 1 -- 172.21.15.176:0/2478762596 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064011990 con 0x7f506815bf50 2023-11-24T06:13:17.275 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.270+0000 7f506cd40700 1 -- 172.21.15.176:0/2478762596 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064011d20 con 0x7f506815bf50 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 -- 172.21.15.176:0/2478762596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 msgr2=0x7f50680ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 --2- 172.21.15.176:0/2478762596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f50680ce2f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5068072420 tx=0x7f5064009b20 comp rx=0 tx=0).stop 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 -- 172.21.15.176:0/2478762596 shutdown_connections 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 --2- 172.21.15.176:0/2478762596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f50680ce2f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 --2- 172.21.15.176:0/2478762596 >> v2:172.21.15.176:3300/0 conn(0x7f50680ce830 0x7f50680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 -- 172.21.15.176:0/2478762596 >> 172.21.15.176:0/2478762596 conn(0x7f50680b3780 msgr2=0x7f50680b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 -- 172.21.15.176:0/2478762596 shutdown_connections 2023-11-24T06:13:17.276 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.271+0000 7f506ffa6700 1 -- 172.21.15.176:0/2478762596 wait complete. 2023-11-24T06:13:17.278 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.272+0000 7f506ffa6700 1 Processor -- start 2023-11-24T06:13:17.278 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.272+0000 7f506ffa6700 1 -- start start 2023-11-24T06:13:17.278 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 0x7f506814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f5068070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506806c8f0 con 0x7f506815bf50 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506806ba00 con 0x7f50680cf1f0 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506ffa6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506806bce0 con 0x7f50680ce830 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506dd42700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 0x7f506814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506dd42700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 0x7f506814c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41726/0 (socket says 172.21.15.176:41726) 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55868/0 (socket says 172.21.15.176:55868) 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506dd42700 1 -- 172.21.15.176:0/943870090 learned_addr learned my addr 172.21.15.176:0/943870090 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506e543700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f5068070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 -- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 msgr2=0x7f506814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 0x7f506814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 -- 172.21.15.176:0/943870090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 msgr2=0x7f5068070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f5068070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.273+0000 7f506d541700 1 -- 172.21.15.176:0/943870090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5058009550 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f506d541700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9a0 tx=0x7f505800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058004030 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5058004190 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50640094a0 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058004520 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506806c2a0 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5058005d20 con 0x7f50680cf1f0 2023-11-24T06:13:17.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.274+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f505800cba0 con 0x7f50680cf1f0 2023-11-24T06:13:17.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.275+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5068068fb0 con 0x7f50680cf1f0 2023-11-24T06:13:17.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.277+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5058020060 con 0x7f50680cf1f0 2023-11-24T06:13:17.310 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:17.307+0000 7f10cc85f200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:13:17.326 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:17.324+0000 7f11028f5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-24T06:13:17.364 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.361+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a59b21c-afed-4eff-afeb-184886fbb6fd", "id": 2} v 0) v1 -- 0x7f506806ca60 con 0x7f50680cf1f0 2023-11-24T06:13:17.369 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.366+0000 7f505e7fc700 1 -- 172.21.15.176:0/943870090 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a59b21c-afed-4eff-afeb-184886fbb6fd", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f505800c780 con 0x7f50680cf1f0 2023-11-24T06:13:17.370 INFO:teuthology.orchestra.run.smithi176.stdout:2 2023-11-24T06:13:17.370 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 msgr2=0x7f50681e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f505800e9a0 tx=0x7f505800ecb0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 shutdown_connections 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506815bf50 0x7f5068070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f50680ce830 0x7f506814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 --2- 172.21.15.176:0/943870090 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f50680cf1f0 0x7f50681e5f10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 >> 172.21.15.176:0/943870090 conn(0x7f50680b3780 msgr2=0x7f50680b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 shutdown_connections 2023-11-24T06:13:17.371 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.367+0000 7f506ffa6700 1 -- 172.21.15.176:0/943870090 wait complete. 2023-11-24T06:13:17.383 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5 3 2023-11-24T06:13:17.547 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.544+0000 7f5073ddb700 1 Processor -- start 2023-11-24T06:13:17.547 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.544+0000 7f5073ddb700 1 -- start start 2023-11-24T06:13:17.548 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5073ddb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f506c15b370 0x7f506c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.548 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5073ddb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f506c0b3c60 0x7f506c0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5073ddb700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f506c0ae5e0 con 0x7f506c1587f0 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5073ddb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c0b4630 con 0x7f506c15b370 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5073ddb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f506c15be30 con 0x7f506c0b3c60 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f506c0b3c60 0x7f506c0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f506c0b3c60 0x7f506c0b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55876/0 (socket says 172.21.15.176:55876) 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 -- 172.21.15.176:0/494089651 learned_addr learned my addr 172.21.15.176:0/494089651 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5071376700 1 --2- 172.21.15.176:0/494089651 >> v2:172.21.15.106:3300/0 conn(0x7f506c15b370 0x7f506c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 -- 172.21.15.176:0/494089651 >> v2:172.21.15.106:3300/0 conn(0x7f506c15b370 msgr2=0x7f506c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 --2- 172.21.15.176:0/494089651 >> v2:172.21.15.106:3300/0 conn(0x7f506c15b370 0x7f506c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.549 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 -- 172.21.15.176:0/494089651 >> v1:172.21.15.176:6789/0 conn(0x7f506c1587f0 legacy=0x7f506c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 -- 172.21.15.176:0/494089651 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506c15c110 con 0x7f506c0b3c60 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5070b75700 1 -- 172.21.15.176:0/494089651 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3827990332 0 0) 0x7f506c0ae5e0 con 0x7f506c1587f0 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5072378700 1 --2- 172.21.15.176:0/494089651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c0b40f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5064009e50 tx=0x7f506400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87568691e5e1f292 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5070b75700 1 -- 172.21.15.176:0/494089651 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400e070 con 0x7f506c0b3c60 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5070b75700 1 -- 172.21.15.176:0/494089651 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400b8d0 con 0x7f506c0b3c60 2023-11-24T06:13:17.550 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.545+0000 7f5070b75700 1 -- 172.21.15.176:0/494089651 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506400bc80 con 0x7f506c0b3c60 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 -- 172.21.15.176:0/494089651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 msgr2=0x7f506c0b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 --2- 172.21.15.176:0/494089651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c0b40f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5064009e50 tx=0x7f506400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 -- 172.21.15.176:0/494089651 shutdown_connections 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 --2- 172.21.15.176:0/494089651 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c0b40f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 --2- 172.21.15.176:0/494089651 >> v2:172.21.15.106:3300/0 conn(0x7f506c15b370 0x7f506c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 -- 172.21.15.176:0/494089651 >> 172.21.15.176:0/494089651 conn(0x7f506c0d0bf0 msgr2=0x7f506c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 -- 172.21.15.176:0/494089651 shutdown_connections 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.546+0000 7f5073ddb700 1 -- 172.21.15.176:0/494089651 wait complete. 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.547+0000 7f5073ddb700 1 Processor -- start 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.547+0000 7f5073ddb700 1 -- start start 2023-11-24T06:13:17.553 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506c1587f0 0x7f506c0afe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 0x7f506c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c14be20 con 0x7f506c1587f0 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f506c09af10 con 0x7f506c0b3c60 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5073ddb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506c14b860 con 0x7f506c15b370 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5071b77700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 0x7f506c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5071b77700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55878/0 (socket says 172.21.15.176:55878) 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5071b77700 1 -- 172.21.15.176:0/2917597085 learned_addr learned my addr 172.21.15.176:0/2917597085 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5071376700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506c1587f0 0x7f506c0afe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.554 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 -- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 msgr2=0x7f506c159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 -- 172.21.15.176:0/2917597085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506c1587f0 msgr2=0x7f506c0afe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506c1587f0 0x7f506c0afe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.548+0000 7f5072378700 1 -- 172.21.15.176:0/2917597085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064009b30 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f5072378700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 0x7f506c0b0380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d1700 tx=0x7f5064004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5064004840 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50640099b0 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506401c640 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f5073ddb700 1 -- 172.21.15.176:0/2917597085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f506c14bb40 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f5073ddb700 1 -- 172.21.15.176:0/2917597085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f506c0b19d0 con 0x7f506c15b370 2023-11-24T06:13:17.555 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f506401caa0 con 0x7f506c15b370 2023-11-24T06:13:17.556 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.549+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f5064025c50 con 0x7f506c15b370 2023-11-24T06:13:17.556 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.550+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50480052e0 con 0x7f506c15b370 2023-11-24T06:13:17.556 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.552+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5064043ce0 con 0x7f506c15b370 2023-11-24T06:13:17.639 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.636+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5", "id": 3} v 0) v1 -- 0x7f50480058a0 con 0x7f506c15b370 2023-11-24T06:13:17.644 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.642+0000 7f50627fc700 1 -- 172.21.15.176:0/2917597085 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5064032030 con 0x7f506c15b370 2023-11-24T06:13:17.645 INFO:teuthology.orchestra.run.smithi176.stdout:3 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.642+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 msgr2=0x7f506c0b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.642+0000 7f504ffff700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 0x7f506c0b0380 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f506c0d1700 tx=0x7f5064004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.642+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 shutdown_connections 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f506c15b370 0x7f506c0b0380 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f506c0b3c60 0x7f506c159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 --2- 172.21.15.176:0/2917597085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f506c1587f0 0x7f506c0afe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 >> 172.21.15.176:0/2917597085 conn(0x7f506c0d0bf0 msgr2=0x7f506c156910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 shutdown_connections 2023-11-24T06:13:17.646 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.643+0000 7f504ffff700 1 -- 172.21.15.176:0/2917597085 wait complete. 2023-11-24T06:13:17.657 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new a6a59e69-2e4a-4a77-888e-604f5a5c36a7 4 2023-11-24T06:13:17.743 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:17.741+0000 7f10cc85f200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:13:17.778 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.775+0000 7fb965080700 1 Processor -- start 2023-11-24T06:13:17.778 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.775+0000 7fb965080700 1 -- start start 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.775+0000 7fb965080700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb965080700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9600d0140 con 0x7fb96015bf50 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb965080700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9600cf3d0 con 0x7fb9600cef40 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb965080700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96015c330 con 0x7fb9600c6c30 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41746/0 (socket says 172.21.15.176:41746) 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 -- 172.21.15.176:0/3355377445 learned_addr learned my addr 172.21.15.176:0/3355377445 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95f59e700 1 --1- 172.21.15.176:0/3355377445 >> v1:172.21.15.176:6789/0 conn(0x7fb9600cef40 0x7fb9600cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:37904/0 (socket says 172.21.15.176:37904) 2023-11-24T06:13:17.780 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95dd9b700 1 -- 172.21.15.176:0/3355377445 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112228954 0 0) 0x7fb9600cf3d0 con 0x7fb9600cef40 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 -- 172.21.15.176:0/3355377445 >> v1:172.21.15.176:6789/0 conn(0x7fb9600cef40 legacy=0x7fb9600cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 -- 172.21.15.176:0/3355377445 >> v1:172.21.15.106:6789/0 conn(0x7fb96015bf50 legacy=0x7fb9600ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 -- 172.21.15.176:0/3355377445 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600d03e0 con 0x7fb9600c6c30 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95e59c700 1 --2- 172.21.15.176:0/3355377445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb954009920 tx=0x7fb954009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2394b6326238e83f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95dd9b700 1 -- 172.21.15.176:0/3355377445 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95400ba60 con 0x7fb9600c6c30 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95dd9b700 1 -- 172.21.15.176:0/3355377445 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95400bbc0 con 0x7fb9600c6c30 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.776+0000 7fb95dd9b700 1 -- 172.21.15.176:0/3355377445 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954009e70 con 0x7fb9600c6c30 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 -- 172.21.15.176:0/3355377445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 msgr2=0x7fb9600cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 --2- 172.21.15.176:0/3355377445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb954009920 tx=0x7fb954009c30 comp rx=0 tx=0).stop 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 -- 172.21.15.176:0/3355377445 shutdown_connections 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 --2- 172.21.15.176:0/3355377445 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb9600c6c30 0x7fb9600cea00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.781 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 -- 172.21.15.176:0/3355377445 >> 172.21.15.176:0/3355377445 conn(0x7fb9600b3780 msgr2=0x7fb9600b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.782 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 -- 172.21.15.176:0/3355377445 shutdown_connections 2023-11-24T06:13:17.782 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.777+0000 7fb965080700 1 -- 172.21.15.176:0/3355377445 wait complete. 2023-11-24T06:13:17.782 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.778+0000 7fb965080700 1 Processor -- start 2023-11-24T06:13:17.782 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.778+0000 7fb965080700 1 -- start start 2023-11-24T06:13:17.783 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:17.779+0000 7f11028f5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600c6c30 0x7fb9600701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 0x7fb96015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96015c470 con 0x7fb9600c6c30 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96015f350 con 0x7fb9600cef40 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb965080700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96015c6c0 con 0x7fb96015bf50 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb95e59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb95e59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55892/0 (socket says 172.21.15.176:55892) 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb95e59c700 1 -- 172.21.15.176:0/318592976 learned_addr learned my addr 172.21.15.176:0/318592976 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:17.785 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb95f59e700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 0x7fb96015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.779+0000 7fb95ed9d700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600c6c30 0x7fb9600701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 -- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 msgr2=0x7fb96015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 0x7fb96015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 -- 172.21.15.176:0/318592976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600c6c30 msgr2=0x7fb9600701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600c6c30 0x7fb9600701b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 -- 172.21.15.176:0/318592976 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb954009550 con 0x7fb9600cef40 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95f59e700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 0x7fb96015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb95e59c700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb954000c00 tx=0x7fb954004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011970 con 0x7fb9600cef40 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95401f070 con 0x7fb9600cef40 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb96015c9a0 con 0x7fb9600cef40 2023-11-24T06:13:17.786 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb954011cd0 con 0x7fb9600cef40 2023-11-24T06:13:17.787 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9600cbd00 con 0x7fb9600cef40 2023-11-24T06:13:17.787 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb954026780 con 0x7fb9600cef40 2023-11-24T06:13:17.787 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.780+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb954021070 con 0x7fb9600cef40 2023-11-24T06:13:17.787 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.781+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb960068fb0 con 0x7fb9600cef40 2023-11-24T06:13:17.787 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.783+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb954015020 con 0x7fb9600cef40 2023-11-24T06:13:17.871 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.868+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a6a59e69-2e4a-4a77-888e-604f5a5c36a7", "id": 4} v 0) v1 -- 0x7fb9600b7ab0 con 0x7fb9600cef40 2023-11-24T06:13:17.876 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.873+0000 7fb9477fe700 1 -- 172.21.15.176:0/318592976 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a6a59e69-2e4a-4a77-888e-604f5a5c36a7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb954026bc0 con 0x7fb9600cef40 2023-11-24T06:13:17.876 INFO:teuthology.orchestra.run.smithi176.stdout:4 2023-11-24T06:13:17.877 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 msgr2=0x7fb96015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:17.877 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb954000c00 tx=0x7fb954004750 comp rx=0 tx=0).stop 2023-11-24T06:13:17.877 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 shutdown_connections 2023-11-24T06:13:17.877 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb96015bf50 0x7fb96015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.878 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9600c6c30 0x7fb9600701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.878 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 --2- 172.21.15.176:0/318592976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb9600cef40 0x7fb96015e770 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:17.878 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 >> 172.21.15.176:0/318592976 conn(0x7fb9600b3780 msgr2=0x7fb9600cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:17.878 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 shutdown_connections 2023-11-24T06:13:17.878 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:17.874+0000 7fb965080700 1 -- 172.21.15.176:0/318592976 wait complete. 2023-11-24T06:13:17.888 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5 5 2023-11-24T06:13:18.010 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.007+0000 7f3e9228a700 1 Processor -- start 2023-11-24T06:13:18.010 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.007+0000 7f3e9228a700 1 -- start start 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.008+0000 7f3e9228a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 0x7f3e8c0d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.008+0000 7f3e9228a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c0d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.008+0000 7f3e9228a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e8c0b80e0 con 0x7f3e8c0d39d0 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.008+0000 7f3e9228a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8c15e520 con 0x7f3e8c15e140 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.008+0000 7f3e9228a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0d2930 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.013 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c0d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8b7fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f3e8c0d39d0 0x7f3e8c0b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:37914/0 (socket says 172.21.15.176:37914) 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8b7fe700 1 -- 172.21.15.176:0/388706792 learned_addr learned my addr 172.21.15.176:0/388706792 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8bfff700 1 --2- 172.21.15.176:0/388706792 >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 0x7f3e8c0d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 -- 172.21.15.176:0/388706792 >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 msgr2=0x7f3e8c0d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 --2- 172.21.15.176:0/388706792 >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 0x7f3e8c0d3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 -- 172.21.15.176:0/388706792 >> v1:172.21.15.176:6789/0 conn(0x7f3e8c0d39d0 legacy=0x7f3e8c0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 -- 172.21.15.176:0/388706792 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c0d2c10 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8affd700 1 -- 172.21.15.176:0/388706792 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122443641 0 0) 0x7f3e80001110 con 0x7f3e8c0d39d0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8bfff700 1 --2- 172.21.15.176:0/388706792 >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 0x7f3e8c0d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e90827700 1 --2- 172.21.15.176:0/388706792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c0d4400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b66620e87c5f44fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8affd700 1 -- 172.21.15.176:0/388706792 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8400e070 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.014 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8affd700 1 -- 172.21.15.176:0/388706792 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8400bbd0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.009+0000 7f3e8affd700 1 -- 172.21.15.176:0/388706792 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84012430 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 -- 172.21.15.176:0/388706792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 msgr2=0x7f3e8c0d4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 --2- 172.21.15.176:0/388706792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c0d4400 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009d90 tx=0x7f3e8400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 -- 172.21.15.176:0/388706792 shutdown_connections 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 --2- 172.21.15.176:0/388706792 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c0d4400 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 --2- 172.21.15.176:0/388706792 >> v2:172.21.15.106:3300/0 conn(0x7f3e8c15e140 0x7f3e8c0d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 -- 172.21.15.176:0/388706792 >> 172.21.15.176:0/388706792 conn(0x7f3e8c06b410 msgr2=0x7f3e8c06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 -- 172.21.15.176:0/388706792 shutdown_connections 2023-11-24T06:13:18.015 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.010+0000 7f3e9228a700 1 -- 172.21.15.176:0/388706792 wait complete. 2023-11-24T06:13:18.017 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.011+0000 7f3e9228a700 1 Processor -- start 2023-11-24T06:13:18.017 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.011+0000 7f3e9228a700 1 -- start start 2023-11-24T06:13:18.017 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e8c0d39d0 0x7f3e8c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e8c15e140 0x7f3e8c0cd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b3970 con 0x7f3e8c15e140 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c0b3c50 con 0x7f3e8c0d39d0 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e9228a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c1f76d0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e8bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e8b7fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e8c0d39d0 0x7f3e8c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e8bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41762/0 (socket says 172.21.15.176:41762) 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.012+0000 7f3e8bfff700 1 -- 172.21.15.176:0/4171017867 learned_addr learned my addr 172.21.15.176:0/4171017867 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 -- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e8c0d39d0 msgr2=0x7f3e8c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e8c0d39d0 0x7f3e8c15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.018 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 -- 172.21.15.176:0/4171017867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e8c15e140 msgr2=0x7f3e8c0cd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e8c15e140 0x7f3e8c0cd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 -- 172.21.15.176:0/4171017867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e84009a70 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e8bfff700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c7f0 tx=0x7f3e7c00cb00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c011800 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c011960 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e8c1f79a0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c011cf0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.013+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e8c1f7f60 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.014+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3e7c01a450 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.014+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3e7c0188e0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.019 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.014+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8c068fb0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.020 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.016+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3e7c039ce0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.104 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.101+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5", "id": 5} v 0) v1 -- 0x7f3e8c0b33e0 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.110 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.107+0000 7f3e88ff9700 1 -- 172.21.15.176:0/4171017867 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3e7c028070 con 0x7f3e8c0b98c0 2023-11-24T06:13:18.110 INFO:teuthology.orchestra.run.smithi176.stdout:5 2023-11-24T06:13:18.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 msgr2=0x7f3e8c1f7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c00c7f0 tx=0x7f3e7c00cb00 comp rx=0 tx=0).stop 2023-11-24T06:13:18.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 shutdown_connections 2023-11-24T06:13:18.111 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e8c15e140 0x7f3e8c0cd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3e8c0b98c0 0x7f3e8c1f7190 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 --2- 172.21.15.176:0/4171017867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3e8c0d39d0 0x7f3e8c15a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 >> 172.21.15.176:0/4171017867 conn(0x7f3e8c06b410 msgr2=0x7f3e8c0ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 shutdown_connections 2023-11-24T06:13:18.112 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.108+0000 7f3e9228a700 1 -- 172.21.15.176:0/4171017867 wait complete. 2023-11-24T06:13:18.123 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new bfe565e7-4df0-4f6e-b55f-a0e0568649f5 6 2023-11-24T06:13:18.269 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.266+0000 7feb4a675700 1 Processor -- start 2023-11-24T06:13:18.269 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.266+0000 7feb4a675700 1 -- start start 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.267+0000 7feb4a675700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.267+0000 7feb4a675700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb4415b370 0x7feb4415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.267+0000 7feb4a675700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4406b530 con 0x7feb440b3c60 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb4a675700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb440ae5e0 con 0x7feb4415b370 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb4a675700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4415be30 con 0x7feb441587f0 2023-11-24T06:13:18.272 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb43fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb4415b370 0x7feb4415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb43fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41768/0 (socket says 172.21.15.176:41768) 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feb4415b370 0x7feb4415b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55910/0 (socket says 172.21.15.176:55910) 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb43fff700 1 -- 172.21.15.176:0/832751005 learned_addr learned my addr 172.21.15.176:0/832751005 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 -- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 msgr2=0x7feb4406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 -- 172.21.15.176:0/832751005 >> v1:172.21.15.106:6789/0 conn(0x7feb440b3c60 legacy=0x7feb440af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 -- 172.21.15.176:0/832751005 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4415c110 con 0x7feb4415b370 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb43fff700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb437fe700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4415b370 0x7feb4415b7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb38009840 tx=0x7feb38009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20838897b4eba6f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb42ffd700 1 -- 172.21.15.176:0/832751005 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011830 con 0x7feb4415b370 2023-11-24T06:13:18.273 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb42ffd700 1 -- 172.21.15.176:0/832751005 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38011990 con 0x7feb4415b370 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.268+0000 7feb42ffd700 1 -- 172.21.15.176:0/832751005 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38011d20 con 0x7feb4415b370 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 -- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4415b370 msgr2=0x7feb4415b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4415b370 0x7feb4415b7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7feb38009840 tx=0x7feb38009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 -- 172.21.15.176:0/832751005 shutdown_connections 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb441587f0 0x7feb4406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 --2- 172.21.15.176:0/832751005 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb4415b370 0x7feb4415b7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 -- 172.21.15.176:0/832751005 >> 172.21.15.176:0/832751005 conn(0x7feb440d0bf0 msgr2=0x7feb440d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 -- 172.21.15.176:0/832751005 shutdown_connections 2023-11-24T06:13:18.274 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.269+0000 7feb4a675700 1 -- 172.21.15.176:0/832751005 wait complete. 2023-11-24T06:13:18.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.271+0000 7feb4a675700 1 Processor -- start 2023-11-24T06:13:18.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.271+0000 7feb4a675700 1 -- start start 2023-11-24T06:13:18.279 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb440b3c60 0x7feb4406c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4415b370 0x7feb441551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb44145e70 con 0x7feb440b3c60 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb441f0290 con 0x7feb441587f0 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb441ef680 con 0x7feb4415b370 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55916/0 (socket says 172.21.15.176:55916) 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 -- 172.21.15.176:0/3619921712 learned_addr learned my addr 172.21.15.176:0/3619921712 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb48c12700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4415b370 0x7feb441551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb43fff700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb440b3c60 0x7feb4406c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.280 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 -- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4415b370 msgr2=0x7feb441551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4415b370 0x7feb441551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 -- 172.21.15.176:0/3619921712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb440b3c60 msgr2=0x7feb4406c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb440b3c60 0x7feb4406c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 -- 172.21.15.176:0/3619921712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3400b7f0 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb437fe700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb38014040 tx=0x7feb38004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380036a0 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3801f070 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38003a20 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb380094a0 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.272+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb441efc40 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.273+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb38026480 con 0x7feb441587f0 2023-11-24T06:13:18.281 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.273+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7feb38021070 con 0x7feb441587f0 2023-11-24T06:13:18.282 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.273+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb44068fb0 con 0x7feb441587f0 2023-11-24T06:13:18.282 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.275+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7feb3802b020 con 0x7feb441587f0 2023-11-24T06:13:18.363 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.360+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bfe565e7-4df0-4f6e-b55f-a0e0568649f5", "id": 6} v 0) v1 -- 0x7feb4406cb30 con 0x7feb441587f0 2023-11-24T06:13:18.368 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:18.366+0000 7f10cc85f200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:13:18.372 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.369+0000 7feb40ff9700 1 -- 172.21.15.176:0/3619921712 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bfe565e7-4df0-4f6e-b55f-a0e0568649f5", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7feb38015020 con 0x7feb441587f0 2023-11-24T06:13:18.372 INFO:teuthology.orchestra.run.smithi176.stdout:6 2023-11-24T06:13:18.373 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 msgr2=0x7feb4409aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7feb38014040 tx=0x7feb38004750 comp rx=0 tx=0).stop 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 shutdown_connections 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feb4415b370 0x7feb441551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb440b3c60 0x7feb4406c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 --2- 172.21.15.176:0/3619921712 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feb441587f0 0x7feb4409aea0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 >> 172.21.15.176:0/3619921712 conn(0x7feb440d0bf0 msgr2=0x7feb440aef20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 shutdown_connections 2023-11-24T06:13:18.374 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.370+0000 7feb4a675700 1 -- 172.21.15.176:0/3619921712 wait complete. 2023-11-24T06:13:18.386 DEBUG:teuthology.orchestra.run.smithi176:> sudo ceph --cluster ceph osd new 8976da24-a35e-4a27-a78a-4927f329f787 7 2023-11-24T06:13:18.437 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:18.434+0000 7f10cc85f200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:13:18.464 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:18.462+0000 7f11028f5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-11-24T06:13:18.509 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.506+0000 7f16acf30700 1 Processor -- start 2023-11-24T06:13:18.509 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.506+0000 7f16acf30700 1 -- start start 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16acf30700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 0x7f16a80b5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16acf30700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80b5ea0 con 0x7f16a8073f90 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16acf30700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16a80b4530 con 0x7f16a806f480 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16acf30700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80b3d00 con 0x7f16a815e390 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a659c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 0x7f16a80b5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a5d9b700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f16a806f480 0x7f16a806e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.176:37936/0 (socket says 172.21.15.176:37936) 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a5d9b700 1 -- 172.21.15.176:0/4244345678 learned_addr learned my addr 172.21.15.176:0/4244345678 (peer_addr_for_me v1:172.21.15.176:0/0) 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953720536 0 0) 0x7f16a80b4530 con 0x7f16a806f480 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16900035b0 con 0x7f16a806f480 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a659c700 1 -- 172.21.15.176:0/4244345678 >> v1:172.21.15.176:6789/0 conn(0x7f16a806f480 legacy=0x7f16a806e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a659c700 1 -- 172.21.15.176:0/4244345678 >> v1:172.21.15.106:6789/0 conn(0x7f16a8073f90 legacy=0x7f16a806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.511 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082507138 0 0) 0x7f16a80b5ea0 con 0x7f16a8073f90 2023-11-24T06:13:18.512 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a659c700 1 -- 172.21.15.176:0/4244345678 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16a806ee10 con 0x7f16a815e390 2023-11-24T06:13:18.512 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.507+0000 7f16a659c700 1 --2- 172.21.15.176:0/4244345678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 0x7f16a80b5960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1698009870 tx=0x7f1698009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136e59ee95eb6006 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.512 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011830 con 0x7f16a815e390 2023-11-24T06:13:18.512 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1698011990 con 0x7f16a815e390 2023-11-24T06:13:18.512 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16a559a700 1 -- 172.21.15.176:0/4244345678 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1698011d20 con 0x7f16a815e390 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 -- 172.21.15.176:0/4244345678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 msgr2=0x7f16a80b5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 --2- 172.21.15.176:0/4244345678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 0x7f16a80b5960 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1698009870 tx=0x7f1698009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 -- 172.21.15.176:0/4244345678 shutdown_connections 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 --2- 172.21.15.176:0/4244345678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a815e390 0x7f16a80b5960 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 -- 172.21.15.176:0/4244345678 >> 172.21.15.176:0/4244345678 conn(0x7f16a80d0bf0 msgr2=0x7f16a80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 -- 172.21.15.176:0/4244345678 shutdown_connections 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.508+0000 7f16acf30700 1 -- 172.21.15.176:0/4244345678 wait complete. 2023-11-24T06:13:18.513 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 Processor -- start 2023-11-24T06:13:18.514 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 -- start start 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16a80b1ca0 0x7f16a81601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a80b2150 con 0x7f16a80b1ca0 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16a81617f0 con 0x7f16a806f480 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.510+0000 7f16acf30700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16a8160f50 con 0x7f16a8073f90 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a659c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.516 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.176:41788/0 (socket says 172.21.15.176:41788) 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a659c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.176:55926/0 (socket says 172.21.15.176:55926) 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 -- 172.21.15.176:0/425646125 learned_addr learned my addr 172.21.15.176:0/425646125 (peer_addr_for_me v2:172.21.15.176:0/0) 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a6d9d700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16a80b1ca0 0x7f16a81601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 -- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 msgr2=0x7f16a8140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 -- 172.21.15.176:0/425646125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16a80b1ca0 msgr2=0x7f16a81601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16a80b1ca0 0x7f16a81601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 -- 172.21.15.176:0/425646125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16980094a0 con 0x7f16a8073f90 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a659c700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16a5d9b700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c430 tx=0x7f169c00c740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c005d70 con 0x7f16a8073f90 2023-11-24T06:13:18.517 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00ce40 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16a8161230 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0072f0 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16a8153170 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f169c01c440 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.511+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f169c0077a0 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.512+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8152fd0 con 0x7f16a8073f90 2023-11-24T06:13:18.518 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.514+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f16a8152fd0 con 0x7f16a8073f90 2023-11-24T06:13:18.540 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:18.537+0000 7f11028f5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-24T06:13:18.604 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.601+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8976da24-a35e-4a27-a78a-4927f329f787", "id": 7} v 0) v1 -- 0x7f16a8153390 con 0x7f16a8073f90 2023-11-24T06:13:18.611 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.608+0000 7f1696ffd700 1 -- 172.21.15.176:0/425646125 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8976da24-a35e-4a27-a78a-4927f329f787", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f169c017070 con 0x7f16a8073f90 2023-11-24T06:13:18.611 INFO:teuthology.orchestra.run.smithi176.stdout:7 2023-11-24T06:13:18.612 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 msgr2=0x7f16a80b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.612 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f169c00c430 tx=0x7f169c00c740 comp rx=0 tx=0).stop 2023-11-24T06:13:18.612 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 shutdown_connections 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16a80b1ca0 0x7f16a81601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f16a806f480 0x7f16a8140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 --2- 172.21.15.176:0/425646125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f16a8073f90 0x7f16a80b1760 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 >> 172.21.15.176:0/425646125 conn(0x7f16a80d0bf0 msgr2=0x7f16a8152740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 shutdown_connections 2023-11-24T06:13:18.613 INFO:teuthology.orchestra.run.smithi176.stderr:2023-11-24T06:13:18.609+0000 7f16acf30700 1 -- 172.21.15.176:0/425646125 wait complete. 2023-11-24T06:13:18.624 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-24T06:13:18.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-24T06:13:18.627 INFO:tasks.ceph.osd.0:Started 2023-11-24T06:13:18.627 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-24T06:13:18.627 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-24T06:13:18.629 INFO:tasks.ceph.osd.1:Started 2023-11-24T06:13:18.629 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-24T06:13:18.629 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-24T06:13:18.631 INFO:tasks.ceph.osd.2:Started 2023-11-24T06:13:18.631 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-24T06:13:18.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-24T06:13:18.633 INFO:tasks.ceph.osd.3:Started 2023-11-24T06:13:18.633 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-24T06:13:18.633 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-24T06:13:18.635 INFO:tasks.ceph.osd.4:Started 2023-11-24T06:13:18.635 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-24T06:13:18.636 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-24T06:13:18.637 INFO:tasks.ceph.osd.5:Started 2023-11-24T06:13:18.638 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-24T06:13:18.638 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-24T06:13:18.640 INFO:tasks.ceph.osd.6:Started 2023-11-24T06:13:18.641 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-24T06:13:18.641 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-24T06:13:18.643 INFO:tasks.ceph.osd.7:Started 2023-11-24T06:13:18.644 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:18.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.793+0000 7f3c3f68d700 1 Processor -- start 2023-11-24T06:13:18.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.794+0000 7f3c3f68d700 1 -- start start 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.794+0000 7f3c3f68d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 0x7f3c381604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.794+0000 7f3c3f68d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380b22d0 con 0x7f3c380b3370 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.794+0000 7f3c3f68d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c380b25b0 con 0x7f3c380d1c70 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.794+0000 7f3c3f68d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c380b2f50 con 0x7f3c3815bdd0 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3cc28700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3c380b3370 0x7f3c380b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37382/0 (socket says 172.21.15.106:37382) 2023-11-24T06:13:18.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3cc28700 1 -- 172.21.15.106:0/4116004432 learned_addr learned my addr 172.21.15.106:0/4116004432 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3d429700 1 --2- 172.21.15.106:0/4116004432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 0x7f3c381604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601107093 0 0) 0x7f3c380b22d0 con 0x7f3c380b3370 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c240035b0 con 0x7f3c380b3370 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347558227 0 0) 0x7f3c380b25b0 con 0x7f3c380d1c70 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3d429700 1 -- 172.21.15.106:0/4116004432 >> v1:172.21.15.176:6789/0 conn(0x7f3c380d1c70 legacy=0x7f3c38165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3d429700 1 -- 172.21.15.106:0/4116004432 >> v1:172.21.15.106:6789/0 conn(0x7f3c380b3370 legacy=0x7f3c380b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3d429700 1 -- 172.21.15.106:0/4116004432 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c380b2890 con 0x7f3c3815bdd0 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c3d429700 1 --2- 172.21.15.106:0/4116004432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 0x7f3c381604e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009870 tx=0x7f3c34009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da5b1b5bbd596d10 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011830 con 0x7f3c3815bdd0 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c34011990 con 0x7f3c3815bdd0 2023-11-24T06:13:18.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.795+0000 7f3c2ffff700 1 -- 172.21.15.106:0/4116004432 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34011d20 con 0x7f3c3815bdd0 2023-11-24T06:13:18.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 -- 172.21.15.106:0/4116004432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 msgr2=0x7f3c381604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/4116004432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 0x7f3c381604e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3c34009870 tx=0x7f3c34009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 -- 172.21.15.106:0/4116004432 shutdown_connections 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/4116004432 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c3815bdd0 0x7f3c381604e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 -- 172.21.15.106:0/4116004432 >> 172.21.15.106:0/4116004432 conn(0x7f3c380731a0 msgr2=0x7f3c3809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 -- 172.21.15.106:0/4116004432 shutdown_connections 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.796+0000 7f3c3f68d700 1 -- 172.21.15.106:0/4116004432 wait complete. 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.797+0000 7f3c3f68d700 1 Processor -- start 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.797+0000 7f3c3f68d700 1 -- start start 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 0x7f3c38154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c380d1c70 0x7f3c380c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381f7c70 con 0x7f3c3815bdd0 2023-11-24T06:13:18.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381f7340 con 0x7f3c380d1c70 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3f68d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c381f7620 con 0x7f3c380b3370 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3d429700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 0x7f3c38154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57128/0 (socket says 172.21.15.106:57128) 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 -- 172.21.15.106:0/1521078736 learned_addr learned my addr 172.21.15.106:0/1521078736 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3cc28700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c380d1c70 0x7f3c380c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 -- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 msgr2=0x7f3c38154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 0x7f3c38154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 -- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c380d1c70 msgr2=0x7f3c380c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c380d1c70 0x7f3c380c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3dc2a700 1 -- 172.21.15.106:0/1521078736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340094a0 con 0x7f3c3815bdd0 2023-11-24T06:13:18.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.798+0000 7f3c3d429700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 0x7f3c38154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c3dc2a700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c30001560 tx=0x7f3c3000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30003e30 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c30005070 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c381f7900 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c30005420 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c38155cf0 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c30012400 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.799+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3c3001bb80 con 0x7f3c3815bdd0 2023-11-24T06:13:18.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.800+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c381f7480 con 0x7f3c3815bdd0 2023-11-24T06:13:18.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.802+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3c381f7480 con 0x7f3c3815bdd0 2023-11-24T06:13:18.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.872+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c381f7760 con 0x7f3c3815bdd0 2023-11-24T06:13:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.872+0000 7f3c2dffb700 1 -- 172.21.15.106:0/1521078736 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3c381f7760 con 0x7f3c3815bdd0 2023-11-24T06:13:18.875 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:18.875 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":10,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:18.603585+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 msgr2=0x7f3c380c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3c30001560 tx=0x7f3c3000cb50 comp rx=0 tx=0).stop 2023-11-24T06:13:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 shutdown_connections 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c3815bdd0 0x7f3c380c82d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c380b3370 0x7f3c38154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 --2- 172.21.15.106:0/1521078736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c380d1c70 0x7f3c380c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 >> 172.21.15.106:0/1521078736 conn(0x7f3c380731a0 msgr2=0x7f3c3809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.873+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 shutdown_connections 2023-11-24T06:13:18.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:18.874+0000 7f3c3f68d700 1 -- 172.21.15.106:0/1521078736 wait complete. 2023-11-24T06:13:18.888 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-24T06:13:18.888 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-24T06:13:19.175 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.172+0000 7f10cc85f200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:13:19.251 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.249+0000 7f10cc85f200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:13:19.254 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-24T06:13:19.251+0000 7f93efa6c640 -1 Falling back to public interface 2023-11-24T06:13:19.256 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-11-24T06:13:19.253+0000 7f9f5e4dc640 -1 Falling back to public interface 2023-11-24T06:13:19.256 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-24T06:13:19.253+0000 7f3a432a8640 -1 Falling back to public interface 2023-11-24T06:13:19.259 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-11-24T06:13:19.256+0000 7f55320d6640 -1 Falling back to public interface 2023-11-24T06:13:19.262 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-11-24T06:13:19.259+0000 7efc42249640 -1 Falling back to public interface 2023-11-24T06:13:19.263 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-24T06:13:19.260+0000 7f4e90a26640 -1 Falling back to public interface 2023-11-24T06:13:19.265 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-11-24T06:13:19.262+0000 7fd1d0949640 -1 Falling back to public interface 2023-11-24T06:13:19.266 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-24T06:13:19.263+0000 7f4b6fb7c640 -1 Falling back to public interface 2023-11-24T06:13:19.269 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:19.266+0000 7f11028f5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:13:19.348 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:19.345+0000 7f11028f5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-24T06:13:19.394 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.392+0000 7f10cc85f200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:13:19.489 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:19.485+0000 7f11028f5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-24T06:13:19.628 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.625+0000 7f10cc85f200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:13:19.693 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:19.725 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:19.722+0000 7f11028f5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-11-24T06:13:19.809 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.806+0000 7f049c391700 1 Processor -- start 2023-11-24T06:13:19.809 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.807+0000 7f049c391700 1 -- start start 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.807+0000 7f049c391700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04940ce090 0x7f049415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.807+0000 7f049c391700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0494062900 con 0x7f04940ce470 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.807+0000 7f049c391700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04940d1130 con 0x7f04940af2d0 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.807+0000 7f049c391700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0494062340 con 0x7f04940ce090 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049a12d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f04940ce090 0x7f049415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049992c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f04940ce470 0x7f04940cac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37392/0 (socket says 172.21.15.106:37392) 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049992c700 1 -- 172.21.15.106:0/2656031939 learned_addr learned my addr 172.21.15.106:0/2656031939 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:19.811 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049a12d700 1 -- 172.21.15.106:0/2656031939 >> v1:172.21.15.176:6789/0 conn(0x7f04940af2d0 legacy=0x7f04940cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049a12d700 1 -- 172.21.15.106:0/2656031939 >> v1:172.21.15.106:6789/0 conn(0x7f04940ce470 legacy=0x7f04940cac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049a12d700 1 -- 172.21.15.106:0/2656031939 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494062620 con 0x7f04940ce090 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049912b700 1 -- 172.21.15.106:0/2656031939 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1669468776 0 0) 0x7f0494062900 con 0x7f04940ce470 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049a12d700 1 --2- 172.21.15.106:0/2656031939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415e170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0490009840 tx=0x7f0490009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4413b048c0e75ae2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049912b700 1 -- 172.21.15.106:0/2656031939 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0490004230 con 0x7f04940ce090 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049912b700 1 -- 172.21.15.106:0/2656031939 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0490004390 con 0x7f04940ce090 2023-11-24T06:13:19.812 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.808+0000 7f049912b700 1 -- 172.21.15.106:0/2656031939 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04900036a0 con 0x7f04940ce090 2023-11-24T06:13:19.813 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 -- 172.21.15.106:0/2656031939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 msgr2=0x7f049415e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.813 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 --2- 172.21.15.106:0/2656031939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415e170 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0490009840 tx=0x7f0490009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:19.813 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 -- 172.21.15.106:0/2656031939 shutdown_connections 2023-11-24T06:13:19.813 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 --2- 172.21.15.106:0/2656031939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415e170 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.813 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 -- 172.21.15.106:0/2656031939 >> 172.21.15.106:0/2656031939 conn(0x7f04940d0250 msgr2=0x7f04940d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:19.814 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 -- 172.21.15.106:0/2656031939 shutdown_connections 2023-11-24T06:13:19.814 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.809+0000 7f049c391700 1 -- 172.21.15.106:0/2656031939 wait complete. 2023-11-24T06:13:19.814 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.810+0000 7f049c391700 1 Processor -- start 2023-11-24T06:13:19.814 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.810+0000 7f049c391700 1 -- start start 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04940af2d0 0x7f04940c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04940ce470 0x7f04940af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04941efd00 con 0x7f04940ce090 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04940aff20 con 0x7f04940ce470 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049c391700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04940b01c0 con 0x7f04940af2d0 2023-11-24T06:13:19.816 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57136/0 (socket says 172.21.15.106:57136) 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 -- 172.21.15.106:0/3055683986 learned_addr learned my addr 172.21.15.106:0/3055683986 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049a12d700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04940af2d0 0x7f04940c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049a92e700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04940ce470 0x7f04940af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 -- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04940af2d0 msgr2=0x7f04940c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04940af2d0 0x7f04940c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 -- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04940ce470 msgr2=0x7f04940af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04940ce470 0x7f04940af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.811+0000 7f049992c700 1 -- 172.21.15.106:0/3055683986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04900094a0 con 0x7f04940ce090 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f049992c700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f048400c520 tx=0x7f048400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484004c80 con 0x7f04940ce090 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484004e00 con 0x7f04940ce090 2023-11-24T06:13:19.817 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0484007310 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04940cf090 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04940b0780 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f048401d3f0 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.812+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f048401dd70 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.813+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f049406e540 con 0x7f04940ce090 2023-11-24T06:13:19.818 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.815+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f048401d750 con 0x7f04940ce090 2023-11-24T06:13:19.843 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.841+0000 7f10cc85f200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:13:19.887 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.884+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04940ae280 con 0x7f04940ce090 2023-11-24T06:13:19.887 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.885+0000 7f048affd700 1 -- 172.21.15.106:0/3055683986 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f048401d9a0 con 0x7f04940ce090 2023-11-24T06:13:19.888 INFO:teuthology.misc.health.smithi106.stdout: 2023-11-24T06:13:19.888 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":10,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:18.603585+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 msgr2=0x7f049415d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f048400c520 tx=0x7f048400c8e0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 shutdown_connections 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04940ce470 0x7f04940af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f04940af2d0 0x7f04940c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.889 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 --2- 172.21.15.106:0/3055683986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04940ce090 0x7f049415d7e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:19.890 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 >> 172.21.15.106:0/3055683986 conn(0x7f04940d0250 msgr2=0x7f04940cce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:19.890 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 shutdown_connections 2023-11-24T06:13:19.890 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:19.886+0000 7f049c391700 1 -- 172.21.15.106:0/3055683986 wait complete. 2023-11-24T06:13:19.900 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:13:19.940 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:19.937+0000 7f11028f5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-24T06:13:19.977 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:19.974+0000 7f10cc85f200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:13:20.073 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.071+0000 7f11028f5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-24T06:13:20.195 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:20.193+0000 7f10cc85f200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:13:20.295 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.292+0000 7f11028f5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-24T06:13:20.349 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:20.347+0000 7f10cc85f200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:13:20.452 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.449+0000 7f11028f5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-24T06:13:20.465 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:20.463+0000 7f10cc85f200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:13:20.568 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.565+0000 7f11028f5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-24T06:13:20.787 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:20.784+0000 7f10cc85f200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:13:20.886 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:20.883+0000 7f10cc85f200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:13:20.895 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.892+0000 7f11028f5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-24T06:13:20.994 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:20.991+0000 7f11028f5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-24T06:13:21.073 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:21.070+0000 7f10cc85f200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:13:21.183 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:21.180+0000 7f11028f5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-24T06:13:21.668 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:21.665+0000 7f10cc85f200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:13:21.792 INFO:tasks.ceph.mgr.x.smithi176.stderr:2023-11-24T06:13:21.789+0000 7f11028f5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-24T06:13:22.691 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:22.688+0000 7f10847b4700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-24T06:13:22.691 INFO:tasks.ceph.mgr.y.smithi106.stderr:2023-11-24T06:13:22.689+0000 7f10847b4700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-24T06:13:22.787 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-24T06:13:22.784+0000 7f93efa6c640 -1 osd.7 0 log_to_monitors true 2023-11-24T06:13:22.793 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-11-24T06:13:22.790+0000 7f9f5e4dc640 -1 osd.3 0 log_to_monitors true 2023-11-24T06:13:22.800 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-24T06:13:22.797+0000 7f3a432a8640 -1 osd.6 0 log_to_monitors true 2023-11-24T06:13:22.804 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-24T06:13:22.798+0000 7f4e90a26640 -1 osd.5 0 log_to_monitors true 2023-11-24T06:13:22.806 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-11-24T06:13:22.803+0000 7f55320d6640 -1 osd.0 0 log_to_monitors true 2023-11-24T06:13:22.807 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-11-24T06:13:22.805+0000 7fd1d0949640 -1 osd.1 0 log_to_monitors true 2023-11-24T06:13:22.815 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-24T06:13:22.812+0000 7f4b6fb7c640 -1 osd.4 0 log_to_monitors true 2023-11-24T06:13:22.830 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-11-24T06:13:22.828+0000 7efc42249640 -1 osd.2 0 log_to_monitors true 2023-11-24T06:13:26.651 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-11-24T06:13:26.647+0000 7fd1c4500700 -1 osd.1 0 waiting for initial osdmap 2023-11-24T06:13:26.664 INFO:tasks.ceph.osd.1.smithi106.stderr:2023-11-24T06:13:26.661+0000 7fd1bc8e0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.669 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-11-24T06:13:26.663+0000 7efc35e00700 -1 osd.2 0 waiting for initial osdmap 2023-11-24T06:13:26.682 INFO:tasks.ceph.osd.2.smithi106.stderr:2023-11-24T06:13:26.679+0000 7efc2e1e0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.706 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:26.719 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-11-24T06:13:26.716+0000 7f5525c8d700 -1 osd.0 0 waiting for initial osdmap 2023-11-24T06:13:26.723 INFO:tasks.ceph.osd.0.smithi106.stderr:2023-11-24T06:13:26.720+0000 7f551e06d700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.726 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-24T06:13:26.722+0000 7f4e845dd700 -1 osd.5 0 waiting for initial osdmap 2023-11-24T06:13:26.727 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-24T06:13:26.718+0000 7f3a36e5f700 -1 osd.6 0 waiting for initial osdmap 2023-11-24T06:13:26.727 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-24T06:13:26.724+0000 7f4b63733700 -1 osd.4 0 waiting for initial osdmap 2023-11-24T06:13:26.735 INFO:tasks.ceph.osd.6.smithi176.stderr:2023-11-24T06:13:26.733+0000 7f3a2f23f700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.738 INFO:tasks.ceph.osd.5.smithi176.stderr:2023-11-24T06:13:26.736+0000 7f4e7c9bd700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.743 INFO:tasks.ceph.osd.4.smithi176.stderr:2023-11-24T06:13:26.741+0000 7f4b5bb13700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.768 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-24T06:13:26.765+0000 7f93e3623700 -1 osd.7 0 waiting for initial osdmap 2023-11-24T06:13:26.783 INFO:tasks.ceph.osd.7.smithi176.stderr:2023-11-24T06:13:26.781+0000 7f93dba03700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:26.823 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.820+0000 7ff2bb95f700 1 Processor -- start 2023-11-24T06:13:26.824 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.820+0000 7ff2bb95f700 1 -- start start 2023-11-24T06:13:26.826 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2bb95f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 0x7ff2b40d1b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.826 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2bb95f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 0x7ff2b40b0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.826 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2bb95f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40aee70 con 0x7ff2b415bf00 2023-11-24T06:13:26.826 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2bb95f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40d24b0 con 0x7ff2b40aea10 2023-11-24T06:13:26.826 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2bb95f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40cc590 con 0x7ff2b40d2040 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b96fb700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff2b415bf00 0x7ff2b40d0450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37500/0 (socket says 172.21.15.106:37500) 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b96fb700 1 -- 172.21.15.106:0/1749833721 learned_addr learned my addr 172.21.15.106:0/1749833721 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b8efa700 1 --2- 172.21.15.106:0/1749833721 >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 0x7ff2b40d1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b9efc700 1 --2- 172.21.15.106:0/1749833721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 0x7ff2b40b0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2abfff700 1 -- 172.21.15.106:0/1749833721 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383297875 0 0) 0x7ff2b40aee70 con 0x7ff2b415bf00 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2abfff700 1 -- 172.21.15.106:0/1749833721 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2a00035b0 con 0x7ff2b415bf00 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b9efc700 1 -- 172.21.15.106:0/1749833721 >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 msgr2=0x7ff2b40d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b9efc700 1 --2- 172.21.15.106:0/1749833721 >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 0x7ff2b40d1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b9efc700 1 -- 172.21.15.106:0/1749833721 >> v1:172.21.15.106:6789/0 conn(0x7ff2b415bf00 legacy=0x7ff2b40d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b9efc700 1 -- 172.21.15.106:0/1749833721 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b415c2e0 con 0x7ff2b40d2040 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.821+0000 7ff2b8efa700 1 --2- 172.21.15.106:0/1749833721 >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 0x7ff2b40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:26.827 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2b9efc700 1 --2- 172.21.15.106:0/1749833721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 0x7ff2b40b0140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009d90 tx=0x7ff2ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0d3cf40e074690 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2abfff700 1 -- 172.21.15.106:0/1749833721 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00e070 con 0x7ff2b40d2040 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2abfff700 1 -- 172.21.15.106:0/1749833721 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00bb20 con 0x7ff2b40d2040 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2abfff700 1 -- 172.21.15.106:0/1749833721 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac012430 con 0x7ff2b40d2040 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 -- 172.21.15.106:0/1749833721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 msgr2=0x7ff2b40b0140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/1749833721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 0x7ff2b40b0140 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac009d90 tx=0x7ff2ac00b330 comp rx=0 tx=0).stop 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 -- 172.21.15.106:0/1749833721 shutdown_connections 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/1749833721 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b40d2040 0x7ff2b40b0140 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/1749833721 >> v2:172.21.15.176:3300/0 conn(0x7ff2b40aea10 0x7ff2b40d1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 -- 172.21.15.106:0/1749833721 >> 172.21.15.106:0/1749833721 conn(0x7ff2b409aa00 msgr2=0x7ff2b409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.822+0000 7ff2bb95f700 1 -- 172.21.15.106:0/1749833721 shutdown_connections 2023-11-24T06:13:26.828 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.823+0000 7ff2bb95f700 1 -- 172.21.15.106:0/1749833721 wait complete. 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.824+0000 7ff2bb95f700 1 Processor -- start 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.824+0000 7ff2bb95f700 1 -- start start 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 0x7ff2b40b3f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b415bf00 0x7ff2b406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b4151c60 con 0x7ff2b40d2040 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b4450 con 0x7ff2b40aea10 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2bb95f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40b37c0 con 0x7ff2b415bf00 2023-11-24T06:13:26.830 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b8efa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b8efa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57246/0 (socket says 172.21.15.106:57246) 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b8efa700 1 -- 172.21.15.106:0/70283359 learned_addr learned my addr 172.21.15.106:0/70283359 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 0x7ff2b40b3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b9efc700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b415bf00 0x7ff2b406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 -- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b415bf00 msgr2=0x7ff2b406f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b415bf00 0x7ff2b406f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 -- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 msgr2=0x7ff2b40b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 -- 172.21.15.106:0/70283359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40094a0 con 0x7ff2b40aea10 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b8efa700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:26.831 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.825+0000 7ff2b96fb700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 0x7ff2b40b3f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c430 tx=0x7ff2b000c740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.832 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.828+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0005d70 con 0x7ff2b40aea10 2023-11-24T06:13:26.832 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.828+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b00070d0 con 0x7ff2b40aea10 2023-11-24T06:13:26.832 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.828+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b0007460 con 0x7ff2b40aea10 2023-11-24T06:13:26.832 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.828+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2ac009a70 con 0x7ff2b40aea10 2023-11-24T06:13:26.832 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.828+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b40b2280 con 0x7ff2b40aea10 2023-11-24T06:13:26.833 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.829+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff2b00075c0 con 0x7ff2b40aea10 2023-11-24T06:13:26.833 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.829+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b4068fb0 con 0x7ff2b40aea10 2023-11-24T06:13:26.833 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.829+0000 7ff2a9ffb700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 0x7ff29806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:26.833 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.829+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7ff2b0087740 con 0x7ff2b40aea10 2023-11-24T06:13:26.834 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.829+0000 7ff2b8efa700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 0x7ff29806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:26.834 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.830+0000 7ff2b8efa700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 0x7ff29806d300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40b7ce0 tx=0x7ff2a4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:26.838 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:26.834+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2b00535d0 con 0x7ff2b40aea10 2023-11-24T06:13:26.840 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-11-24T06:13:26.836+0000 7f9f52093700 -1 osd.3 0 waiting for initial osdmap 2023-11-24T06:13:26.850 INFO:tasks.ceph.osd.3.smithi106.stderr:2023-11-24T06:13:26.847+0000 7f9f4a473700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-24T06:13:27.028 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.024+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2b40c5180 con 0x7ff2b40aea10 2023-11-24T06:13:27.028 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.025+0000 7ff2a9ffb700 1 -- 172.21.15.106:0/70283359 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ff2b0017020 con 0x7ff2b40aea10 2023-11-24T06:13:27.029 INFO:teuthology.misc.health.smithi106.stdout: 2023-11-24T06:13:27.029 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":12,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:24.692002+0000","last_up_change":"0.000000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 msgr2=0x7ff29806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 0x7ff29806d300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2b40b7ce0 tx=0x7ff2a4009210 comp rx=0 tx=0).stop 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 msgr2=0x7ff2b40b3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 0x7ff2b40b3f10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff2b000c430 tx=0x7ff2b000c740 comp rx=0 tx=0).stop 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 shutdown_connections 2023-11-24T06:13:27.031 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff29806ae40 0x7ff29806d300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff2b415bf00 0x7ff2b406f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff2b40aea10 0x7ff2b40b3f10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 --2- 172.21.15.106:0/70283359 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b40d2040 0x7ff2b40b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 >> 172.21.15.106:0/70283359 conn(0x7ff2b409aa00 msgr2=0x7ff2b40c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 shutdown_connections 2023-11-24T06:13:27.032 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:27.027+0000 7ff2bb95f700 1 -- 172.21.15.106:0/70283359 wait complete. 2023-11-24T06:13:27.042 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-24T06:13:33.848 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:33.972 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.969+0000 7f13cc9b0700 1 Processor -- start 2023-11-24T06:13:33.972 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.969+0000 7f13cc9b0700 1 -- start start 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13cc9b0700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f13c80b0560 0x7f13c806e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13cc9b0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80b48f0 con 0x7f13c80746a0 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13cc9b0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c80b4bd0 con 0x7f13c815e250 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13cc9b0700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13c815e630 con 0x7f13c80b0560 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13c5d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f13c80746a0 0x7f13c806dbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37738/0 (socket says 172.21.15.106:37738) 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.970+0000 7f13c5d9b700 1 -- 172.21.15.106:0/3743100623 learned_addr learned my addr 172.21.15.106:0/3743100623 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c6d9d700 1 --2- 172.21.15.106:0/3743100623 >> v2:172.21.15.176:3300/0 conn(0x7f13c80b0560 0x7f13c806e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1150943882 0 0) 0x7f13c80b48f0 con 0x7f13c80746a0 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b00035b0 con 0x7f13c80746a0 2023-11-24T06:13:33.976 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3501483154 0 0) 0x7f13b00035b0 con 0x7f13c80746a0 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 >> v2:172.21.15.176:3300/0 conn(0x7f13c80b0560 msgr2=0x7f13c806e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 --2- 172.21.15.106:0/3743100623 >> v2:172.21.15.176:3300/0 conn(0x7f13c80b0560 0x7f13c806e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 >> v1:172.21.15.176:6789/0 conn(0x7f13c815e250 legacy=0x7f13c8073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c80b50d0 con 0x7f13c80746a0 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f13b8001670 con 0x7f13c80746a0 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 >> v1:172.21.15.106:6789/0 conn(0x7f13c80746a0 legacy=0x7f13c806dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 0x7f13b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13b0004850 0x7f13b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0005330 0x7f13b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815e630 con 0x7f13b0003a00 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b000c200 con 0x7f13b0004850 2023-11-24T06:13:33.977 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b000c3c0 con 0x7f13b0005330 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 0x7f13b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c5d9b700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13b0004850 0x7f13b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c6d9d700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0005330 0x7f13b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 -- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0005330 msgr2=0x7f13b000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0005330 0x7f13b000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 -- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13b0004850 msgr2=0x7f13b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13b0004850 0x7f13b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c659c700 1 -- 172.21.15.106:0/3743100623 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b00035b0 con 0x7f13b0003a00 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.971+0000 7f13c6d9d700 1 -- 172.21.15.106:0/3743100623 reap_dead start 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13c659c700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 0x7f13b0003e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13bc007fd0 tx=0x7f13b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a5c46d416ebf617 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0052d0 con 0x7f13b0003a00 2023-11-24T06:13:33.978 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc005470 con 0x7f13b0003a00 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13c559a700 1 -- 172.21.15.106:0/3743100623 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0038c0 con 0x7f13b0003a00 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 -- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 msgr2=0x7f13b0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 0x7f13b0003e20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13bc007fd0 tx=0x7f13b0005880 comp rx=0 tx=0).stop 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 -- 172.21.15.106:0/3743100623 shutdown_connections 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/3743100623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b0003a00 0x7f13b0003e20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 -- 172.21.15.106:0/3743100623 >> 172.21.15.106:0/3743100623 conn(0x7f13c8072960 msgr2=0x7f13c806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 -- 172.21.15.106:0/3743100623 shutdown_connections 2023-11-24T06:13:33.979 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.972+0000 7f13cc9b0700 1 -- 172.21.15.106:0/3743100623 wait complete. 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.974+0000 7f13cc9b0700 1 Processor -- start 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.974+0000 7f13cc9b0700 1 -- start start 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0003a00 0x7f13c81f70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13c815e770 0x7f13c80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c8144180 con 0x7f13c815ebf0 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815f0f0 con 0x7f13c815e770 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c815f3d0 con 0x7f13b0003a00 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.982 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57492/0 (socket says 172.21.15.106:57492) 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 -- 172.21.15.106:0/393162884 learned_addr learned my addr 172.21.15.106:0/393162884 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c659c700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0003a00 0x7f13c81f70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c5d9b700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13c815e770 0x7f13c80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 -- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0003a00 msgr2=0x7f13c81f70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0003a00 0x7f13c81f70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 -- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13c815e770 msgr2=0x7f13c80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13c815e770 0x7f13c80cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 -- 172.21.15.106:0/393162884 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c815f6b0 con 0x7f13c815ebf0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13c6d9d700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13c8068b70 tx=0x7f13c0011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000e040 con 0x7f13c815ebf0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c000f040 con 0x7f13c815ebf0 2023-11-24T06:13:33.983 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c000f870 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c815f990 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.975+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c81f7600 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.976+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c815feb0 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.977+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f13c000f9d0 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.977+0000 7f13b6ffd700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 0x7f13a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.977+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13c0089700 con 0x7f13c815ebf0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.977+0000 7f13c659c700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 0x7f13a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.978+0000 7f13c659c700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 0x7f13a806d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13bc007fd0 tx=0x7f13bc009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:33.984 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:33.982+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13c815feb0 con 0x7f13c815ebf0 2023-11-24T06:13:34.175 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.173+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13c815feb0 con 0x7f13c815ebf0 2023-11-24T06:13:34.176 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.173+0000 7f13b6ffd700 1 -- 172.21.15.106:0/393162884 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f13c815feb0 con 0x7f13c815ebf0 2023-11-24T06:13:34.176 INFO:teuthology.misc.health.smithi106.stdout: 2023-11-24T06:13:34.176 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":16,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:30.708325+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:34.178 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.175+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 msgr2=0x7f13a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.175+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 0x7f13a806d390 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f13bc007fd0 tx=0x7f13bc009030 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.175+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 msgr2=0x7f13c80cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.175+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f13c8068b70 tx=0x7f13c0011ed0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 shutdown_connections 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f13a806aed0 0x7f13a806d390 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13c815ebf0 0x7f13c80cfcb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f13b0003a00 0x7f13c81f70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 --2- 172.21.15.106:0/393162884 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f13c815e770 0x7f13c80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 >> 172.21.15.106:0/393162884 conn(0x7f13c8072960 msgr2=0x7f13c806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 shutdown_connections 2023-11-24T06:13:34.179 INFO:teuthology.misc.health.smithi106.stderr:2023-11-24T06:13:34.176+0000 7f13cc9b0700 1 -- 172.21.15.106:0/393162884 wait complete. 2023-11-24T06:13:34.190 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-24T06:13:34.190 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-24T06:13:34.190 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:13:34.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:13:34.192 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:13:34.192 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:13:34.193 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:13:34.194 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:13:34.194 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:13:34.195 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:13:34.198 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:13:34.198 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:13:34.199 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:13:34.201 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:13:34.201 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-24T06:13:34.201 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:34.273 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2023-11-24T06:13:34.273 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2023-11-24T06:13:34.288 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-24T06:13:34.288 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-24T06:13:34.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.326+0000 7f29baa64700 1 Processor -- start 2023-11-24T06:13:34.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.326+0000 7f29baa64700 1 -- start start 2023-11-24T06:13:34.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29baa64700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f29b406c710 0x7f29b4165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29baa64700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40af950 con 0x7f29b40adf00 2023-11-24T06:13:34.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29baa64700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40afc30 con 0x7f29b41446a0 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29baa64700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b4144a80 con 0x7f29b406c710 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b3fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29b40adf00 0x7f29b406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37786/0 (socket says 172.21.15.106:37786) 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b3fff700 1 -- 172.21.15.106:0/2722930522 learned_addr learned my addr 172.21.15.106:0/2722930522 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b9001700 1 --2- 172.21.15.106:0/2722930522 >> v2:172.21.15.106:3300/0 conn(0x7f29b406c710 0x7f29b4165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909844408 0 0) 0x7f29b40af950 con 0x7f29b40adf00 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29a40035b0 con 0x7f29b40adf00 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868998812 0 0) 0x7f29b40afc30 con 0x7f29b41446a0 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b9001700 1 -- 172.21.15.106:0/2722930522 >> v1:172.21.15.176:6789/0 conn(0x7f29b41446a0 legacy=0x7f29b40b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b9001700 1 -- 172.21.15.106:0/2722930522 >> v1:172.21.15.106:6789/0 conn(0x7f29b40adf00 legacy=0x7f29b406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b9001700 1 -- 172.21.15.106:0/2722930522 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40aff10 con 0x7f29b406c710 2023-11-24T06:13:34.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.327+0000 7f29b9001700 1 --2- 172.21.15.106:0/2722930522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b406c710 0x7f29b4165b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009d90 tx=0x7f29ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc61d341036b0ec server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00e070 con 0x7f29b406c710 2023-11-24T06:13:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29ac00bb20 con 0x7f29b406c710 2023-11-24T06:13:34.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29b37fe700 1 -- 172.21.15.106:0/2722930522 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29ac00bed0 con 0x7f29b406c710 2023-11-24T06:13:34.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 -- 172.21.15.106:0/2722930522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b406c710 msgr2=0x7f29b4165b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 --2- 172.21.15.106:0/2722930522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b406c710 0x7f29b4165b70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f29ac009d90 tx=0x7f29ac00b330 comp rx=0 tx=0).stop 2023-11-24T06:13:34.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 -- 172.21.15.106:0/2722930522 shutdown_connections 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 --2- 172.21.15.106:0/2722930522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b406c710 0x7f29b4165b70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 -- 172.21.15.106:0/2722930522 >> 172.21.15.106:0/2722930522 conn(0x7f29b4071b90 msgr2=0x7f29b4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 -- 172.21.15.106:0/2722930522 shutdown_connections 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.328+0000 7f29baa64700 1 -- 172.21.15.106:0/2722930522 wait complete. 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.329+0000 7f29baa64700 1 Processor -- start 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.329+0000 7f29baa64700 1 -- start start 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 0x7f29b40cfb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 0x7f29b415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40d0220 con 0x7f29b40adf00 2023-11-24T06:13:34.335 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b40d0040 con 0x7f29b41446a0 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29baa64700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b415c030 con 0x7f29b406c710 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29b3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29b3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57530/0 (socket says 172.21.15.106:57530) 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.330+0000 7f29b3fff700 1 -- 172.21.15.106:0/4036640700 learned_addr learned my addr 172.21.15.106:0/4036640700 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b8800700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 0x7f29b40cfb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b9001700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 0x7f29b415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 -- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 msgr2=0x7f29b40cfb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 0x7f29b40cfb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 -- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 msgr2=0x7f29b415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 0x7f29b415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 -- 172.21.15.106:0/4036640700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac009a70 con 0x7f29b40adf00 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b8800700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 0x7f29b40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:34.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b9001700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 0x7f29b415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b3fff700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c480 tx=0x7f29a000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0005d70 con 0x7f29b40adf00 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00070d0 con 0x7f29b40adf00 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b40cf060 con 0x7f29b40adf00 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a0007460 con 0x7f29b40adf00 2023-11-24T06:13:34.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.331+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b40cf320 con 0x7f29b40adf00 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.332+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b40753f0 con 0x7f29b40adf00 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.332+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f29a00075c0 con 0x7f29b40adf00 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.333+0000 7f29b17fa700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 0x7f299806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.333+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f29a0088750 con 0x7f29b40adf00 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.333+0000 7f29b8800700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 0x7f299806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.333+0000 7f29b8800700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 0x7f299806d390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a8000f60 tx=0x7f29a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.337+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29a0053b50 con 0x7f29b40adf00 2023-11-24T06:13:34.531 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.529+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29b4067f60 con 0x7f29b40adf00 2023-11-24T06:13:34.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.530+0000 7f29b17fa700 1 -- 172.21.15.106:0/4036640700 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f29a0017020 con 0x7f29b40adf00 2023-11-24T06:13:34.532 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:34.533 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:30.708325+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 msgr2=0x7f299806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 0x7f299806d390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f29a8000f60 tx=0x7f29a8009040 comp rx=0 tx=0).stop 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 msgr2=0x7f29b415b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f29a000c480 tx=0x7f29a000c840 comp rx=0 tx=0).stop 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 shutdown_connections 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f299806aed0 0x7f299806d390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29b41446a0 0x7f29b415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29b406c710 0x7f29b40cfb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 --2- 172.21.15.106:0/4036640700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29b40adf00 0x7f29b415b5b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 >> 172.21.15.106:0/4036640700 conn(0x7f29b4071b90 msgr2=0x7f29b40b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 shutdown_connections 2023-11-24T06:13:34.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.532+0000 7f29baa64700 1 -- 172.21.15.106:0/4036640700 wait complete. 2023-11-24T06:13:34.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:34.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:34.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.667+0000 7f25fbb37700 1 Processor -- start 2023-11-24T06:13:34.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.667+0000 7f25fbb37700 1 -- start start 2023-11-24T06:13:34.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25f415e160 0x7f25f40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 0x7f25f4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f40744d0 0x7f25f406d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f40b4500 con 0x7f25f415e160 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25f4074960 con 0x7f25f40afc90 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fbb37700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f40b3c60 con 0x7f25f40744d0 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25f415e160 0x7f25f40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25f415e160 0x7f25f40b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57536/0 (socket says 172.21.15.106:57536) 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 -- 172.21.15.106:0/3072520139 learned_addr learned my addr 172.21.15.106:0/3072520139 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25fa0d4700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f40744d0 0x7f25f406d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f90d2700 1 --2- 172.21.15.106:0/3072520139 >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 0x7f25f4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 -- 172.21.15.106:0/3072520139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f40744d0 msgr2=0x7f25f406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f40744d0 0x7f25f406d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 -- 172.21.15.106:0/3072520139 >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 msgr2=0x7f25f4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 --2- 172.21.15.106:0/3072520139 >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 0x7f25f4073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 -- 172.21.15.106:0/3072520139 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f40b58c0 con 0x7f25f415e160 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f90d2700 1 --2- 172.21.15.106:0/3072520139 >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 0x7f25f4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f98d3700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f415e160 0x7f25f40b5da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25f40d0880 tx=0x7f25f0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca400cecbd2421cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.668+0000 7f25f88d1700 1 -- 172.21.15.106:0/3072520139 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0011830 con 0x7f25f415e160 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25f88d1700 1 -- 172.21.15.106:0/3072520139 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f0011990 con 0x7f25f415e160 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25f88d1700 1 -- 172.21.15.106:0/3072520139 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f0011d20 con 0x7f25f415e160 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 -- 172.21.15.106:0/3072520139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f415e160 msgr2=0x7f25f40b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f415e160 0x7f25f40b5da0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f25f40d0880 tx=0x7f25f0009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 -- 172.21.15.106:0/3072520139 shutdown_connections 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f40744d0 0x7f25f406d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 --2- 172.21.15.106:0/3072520139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f415e160 0x7f25f40b5da0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 --2- 172.21.15.106:0/3072520139 >> v2:172.21.15.176:3300/0 conn(0x7f25f40afc90 0x7f25f4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 -- 172.21.15.106:0/3072520139 >> 172.21.15.106:0/3072520139 conn(0x7f25f40d0bf0 msgr2=0x7f25f40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 -- 172.21.15.106:0/3072520139 shutdown_connections 2023-11-24T06:13:34.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.669+0000 7f25fbb37700 1 -- 172.21.15.106:0/3072520139 wait complete. 2023-11-24T06:13:34.677 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.670+0000 7f25fbb37700 1 Processor -- start 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.670+0000 7f25fbb37700 1 -- start start 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 0x7f25f4145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f415e160 0x7f25f415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415fda0 con 0x7f25f40afc90 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415f190 con 0x7f25f40744d0 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fbb37700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25f415f470 con 0x7f25f415e160 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57544/0 (socket says 172.21.15.106:57544) 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 -- 172.21.15.106:0/2723363030 learned_addr learned my addr 172.21.15.106:0/2723363030 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:34.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25fa0d4700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f415e160 0x7f25f415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f98d3700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 0x7f25f4145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 -- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f415e160 msgr2=0x7f25f415ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f415e160 0x7f25f415ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 -- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 msgr2=0x7f25f4145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 0x7f25f4145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f90d2700 1 -- 172.21.15.106:0/2723363030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0009550 con 0x7f25f40afc90 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.671+0000 7f25f98d3700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 0x7f25f4145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25f90d2700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25e400e810 tx=0x7f25e400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4013610 con 0x7f25f40afc90 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25e4013770 con 0x7f25f40afc90 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25f415f750 con 0x7f25f40afc90 2023-11-24T06:13:34.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25e4013b20 con 0x7f25f40afc90 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.672+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25f4145680 con 0x7f25f40afc90 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.673+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25f4068fb0 con 0x7f25f40afc90 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.673+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f25e4013c80 con 0x7f25f40afc90 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.673+0000 7f25ea7fc700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 0x7f25d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.673+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25e4088f60 con 0x7f25f40afc90 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.673+0000 7f25f98d3700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 0x7f25d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.674+0000 7f25f98d3700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 0x7f25d806d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25f0014040 tx=0x7f25f0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:34.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.678+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25e4054360 con 0x7f25f40afc90 2023-11-24T06:13:34.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.869+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f25f406c140 con 0x7f25f40afc90 2023-11-24T06:13:34.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.870+0000 7f25ea7fc700 1 -- 172.21.15.106:0/2723363030 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f25e4057980 con 0x7f25f40afc90 2023-11-24T06:13:34.873 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:13:34.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 msgr2=0x7f25d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 0x7f25d806d390 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f25f0014040 tx=0x7f25f0008030 comp rx=0 tx=0).stop 2023-11-24T06:13:34.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 msgr2=0x7f25f415e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:34.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25e400e810 tx=0x7f25e400ebd0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 shutdown_connections 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f25d806aed0 0x7f25d806d390 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f25f415e160 0x7f25f415ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f25f40744d0 0x7f25f4145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 --2- 172.21.15.106:0/2723363030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25f40afc90 0x7f25f415e540 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 >> 172.21.15.106:0/2723363030 conn(0x7f25f40d0bf0 msgr2=0x7f25f406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 shutdown_connections 2023-11-24T06:13:34.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:34.872+0000 7f25fbb37700 1 -- 172.21.15.106:0/2723363030 wait complete. 2023-11-24T06:13:34.887 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.004+0000 7f2a86a66700 1 Processor -- start 2023-11-24T06:13:35.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.004+0000 7f2a86a66700 1 -- start start 2023-11-24T06:13:35.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a86a66700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2a80163230 0x7f2a80165620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a86a66700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a8015a790 con 0x7f2a8015a3b0 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a86a66700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a800b4c40 con 0x7f2a800cf360 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a86a66700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a8015eec0 con 0x7f2a80163230 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a84802700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2a8015a3b0 0x7f2a800b3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37812/0 (socket says 172.21.15.106:37812) 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a84802700 1 -- 172.21.15.106:0/1273635873 learned_addr learned my addr 172.21.15.106:0/1273635873 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.005+0000 7f2a7ffff700 1 --1- 172.21.15.106:0/1273635873 >> v1:172.21.15.176:6789/0 conn(0x7f2a800cf360 0x7f2a800b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:60288/0 (socket says 172.21.15.106:60288) 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a85003700 1 --2- 172.21.15.106:0/1273635873 >> v2:172.21.15.176:3300/0 conn(0x7f2a80163230 0x7f2a80165620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43880313 0 0) 0x7f2a8015a790 con 0x7f2a8015a3b0 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a6c0035b0 con 0x7f2a8015a3b0 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3086878929 0 0) 0x7f2a800b4c40 con 0x7f2a800cf360 2023-11-24T06:13:35.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a8015a790 con 0x7f2a800cf360 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a85003700 1 -- 172.21.15.106:0/1273635873 >> v1:172.21.15.176:6789/0 conn(0x7f2a800cf360 legacy=0x7f2a800b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a85003700 1 -- 172.21.15.106:0/1273635873 >> v1:172.21.15.106:6789/0 conn(0x7f2a8015a3b0 legacy=0x7f2a800b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a85003700 1 -- 172.21.15.106:0/1273635873 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a800b4140 con 0x7f2a80163230 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a85003700 1 --2- 172.21.15.106:0/1273635873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80165620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009d90 tx=0x7f2a7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1429b9a52e4d3c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a7800e070 con 0x7f2a80163230 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a7800bb20 con 0x7f2a80163230 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.006+0000 7f2a7f7fe700 1 -- 172.21.15.106:0/1273635873 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a78012430 con 0x7f2a80163230 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 -- 172.21.15.106:0/1273635873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 msgr2=0x7f2a80165620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 --2- 172.21.15.106:0/1273635873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80165620 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a78009d90 tx=0x7f2a7800b330 comp rx=0 tx=0).stop 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 -- 172.21.15.106:0/1273635873 shutdown_connections 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 --2- 172.21.15.106:0/1273635873 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80165620 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 -- 172.21.15.106:0/1273635873 >> 172.21.15.106:0/1273635873 conn(0x7f2a800b1740 msgr2=0x7f2a800b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 -- 172.21.15.106:0/1273635873 shutdown_connections 2023-11-24T06:13:35.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.007+0000 7f2a86a66700 1 -- 172.21.15.106:0/1273635873 wait complete. 2023-11-24T06:13:35.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.008+0000 7f2a86a66700 1 Processor -- start 2023-11-24T06:13:35.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.008+0000 7f2a86a66700 1 -- start start 2023-11-24T06:13:35.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a8015a3b0 0x7f2a800ce840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80148fd0 con 0x7f2a800cf360 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a80141330 con 0x7f2a80163230 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a86a66700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a800ce3b0 con 0x7f2a8015a3b0 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57556/0 (socket says 172.21.15.106:57556) 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 -- 172.21.15.106:0/761171788 learned_addr learned my addr 172.21.15.106:0/761171788 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a7ffff700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a8015a3b0 0x7f2a800ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a85003700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 -- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a8015a3b0 msgr2=0x7f2a800ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a8015a3b0 0x7f2a800ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 -- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 msgr2=0x7f2a80147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a84802700 1 -- 172.21.15.106:0/761171788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78009a70 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.009+0000 7f2a85003700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a84802700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c730 tx=0x7f2a7000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70005d70 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a700070d0 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a80148a10 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a70007480 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.010+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a800ce040 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.011+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a800cdea0 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.011+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a700075e0 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.011+0000 7f2a7d7fa700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 0x7f2a6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.012+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2a70088870 con 0x7f2a800cf360 2023-11-24T06:13:35.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.012+0000 7f2a7ffff700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 0x7f2a6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:35.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.012+0000 7f2a7ffff700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 0x7f2a6006d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a801506a0 tx=0x7f2a68007c00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:35.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.016+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a800cdea0 con 0x7f2a800cf360 2023-11-24T06:13:35.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.249+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a800cdea0 con 0x7f2a800cf360 2023-11-24T06:13:35.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.249+0000 7f2a7d7fa700 1 -- 172.21.15.106:0/761171788 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f2a800cdea0 con 0x7f2a800cf360 2023-11-24T06:13:35.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:35.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 msgr2=0x7f2a6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 0x7f2a6006d390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2a801506a0 tx=0x7f2a68007c00 comp rx=0 tx=0).stop 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 msgr2=0x7f2a80140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2a7000c730 tx=0x7f2a7000caf0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 shutdown_connections 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2a6006aed0 0x7f2a6006d390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2a80163230 0x7f2a80147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a800cf360 0x7f2a80140df0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 --2- 172.21.15.106:0/761171788 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2a8015a3b0 0x7f2a800ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:35.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 >> 172.21.15.106:0/761171788 conn(0x7f2a800b1740 msgr2=0x7f2a8006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:35.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 shutdown_connections 2023-11-24T06:13:35.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:35.252+0000 7f2a86a66700 1 -- 172.21.15.106:0/761171788 wait complete. 2023-11-24T06:13:35.256 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 2 2023-11-24T06:13:37.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:37.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.398+0000 7fd0bd0bf700 1 Processor -- start 2023-11-24T06:13:37.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.398+0000 7fd0bd0bf700 1 -- start start 2023-11-24T06:13:37.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0bd0bf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd0b815e080 0x7fd0b80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0bd0bf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0b806c710 0x7fd0b80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0bd0bf700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0b80ae430 con 0x7fd0b80af4d0 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0bd0bf700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80af0b0 con 0x7fd0b806c710 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0bd0bf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0b80b05a0 con 0x7fd0b815e080 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0b806c710 0x7fd0b80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b659c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd0b80af4d0 0x7fd0b806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37828/0 (socket says 172.21.15.106:37828) 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b659c700 1 -- 172.21.15.106:0/2064505149 learned_addr learned my addr 172.21.15.106:0/2064505149 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b6d9d700 1 --2- 172.21.15.106:0/2064505149 >> v2:172.21.15.176:3300/0 conn(0x7fd0b815e080 0x7fd0b80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 -- 172.21.15.106:0/2064505149 >> v2:172.21.15.176:3300/0 conn(0x7fd0b815e080 msgr2=0x7fd0b80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 --2- 172.21.15.106:0/2064505149 >> v2:172.21.15.176:3300/0 conn(0x7fd0b815e080 0x7fd0b80b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 -- 172.21.15.106:0/2064505149 >> v1:172.21.15.106:6789/0 conn(0x7fd0b80af4d0 legacy=0x7fd0b806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b5d9b700 1 -- 172.21.15.106:0/2064505149 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653421772 0 0) 0x7fd0b80ae430 con 0x7fd0b80af4d0 2023-11-24T06:13:37.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 -- 172.21.15.106:0/2064505149 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b80ae710 con 0x7fd0b806c710 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b759e700 1 --2- 172.21.15.106:0/2064505149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b80afb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8072a90 tx=0x7fd0b000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15c04f07b23d5d9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.399+0000 7fd0b5d9b700 1 -- 172.21.15.106:0/2064505149 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b000e070 con 0x7fd0b806c710 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0b5d9b700 1 -- 172.21.15.106:0/2064505149 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b000bb90 con 0x7fd0b806c710 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0b5d9b700 1 -- 172.21.15.106:0/2064505149 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0012430 con 0x7fd0b806c710 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2064505149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 msgr2=0x7fd0b80afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2064505149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b80afb90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8072a90 tx=0x7fd0b000b330 comp rx=0 tx=0).stop 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2064505149 shutdown_connections 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2064505149 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b80afb90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2064505149 >> v2:172.21.15.176:3300/0 conn(0x7fd0b815e080 0x7fd0b80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2064505149 >> 172.21.15.106:0/2064505149 conn(0x7fd0b8071b90 msgr2=0x7fd0b8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2064505149 shutdown_connections 2023-11-24T06:13:37.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.400+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2064505149 wait complete. 2023-11-24T06:13:37.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 Processor -- start 2023-11-24T06:13:37.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 -- start start 2023-11-24T06:13:37.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 0x7fd0b81f7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0b815e080 0x7fd0b8148160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b81f7ef0 con 0x7fd0b806c710 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b8153bb0 con 0x7fd0b80af4d0 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0bd0bf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b815f470 con 0x7fd0b815e080 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.402+0000 7fd0b6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57572/0 (socket says 172.21.15.106:57572) 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 -- 172.21.15.106:0/2038757094 learned_addr learned my addr 172.21.15.106:0/2038757094 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b659c700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 0x7fd0b81f7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b759e700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0b815e080 0x7fd0b8148160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 -- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0b815e080 msgr2=0x7fd0b8148160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0b815e080 0x7fd0b8148160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 -- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 msgr2=0x7fd0b81f7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 0x7fd0b81f7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 -- 172.21.15.106:0/2038757094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b0009a70 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b659c700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 0x7fd0b81f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0b6d9d700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c7f0 tx=0x7fd0ac00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011800 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ac011960 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b815f750 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ac011cf0 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.403+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b814f990 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.404+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0b80753f0 con 0x7fd0b806c710 2023-11-24T06:13:37.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.404+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd0ac018360 con 0x7fd0b806c710 2023-11-24T06:13:37.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.405+0000 7fd09f7fe700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 0x7fd0a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.405+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd0ac089110 con 0x7fd0b806c710 2023-11-24T06:13:37.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.405+0000 7fd0b659c700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 0x7fd0a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.405+0000 7fd0b659c700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 0x7fd0a406d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80b5e60 tx=0x7fd0a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.410+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd0ac0545a0 con 0x7fd0b806c710 2023-11-24T06:13:37.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.642+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0b814fb80 con 0x7fd0b806c710 2023-11-24T06:13:37.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.642+0000 7fd09f7fe700 1 -- 172.21.15.106:0/2038757094 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7fd0ac01fe90 con 0x7fd0b806c710 2023-11-24T06:13:37.645 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:37.645 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-11-24T06:13:37.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 msgr2=0x7fd0a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 0x7fd0a406d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80b5e60 tx=0x7fd0a8009040 comp rx=0 tx=0).stop 2023-11-24T06:13:37.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 msgr2=0x7fd0b81565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac00c7f0 tx=0x7fd0ac00cbb0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 shutdown_connections 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd0a406aed0 0x7fd0a406d390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd0b815e080 0x7fd0b8148160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0b806c710 0x7fd0b81565d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 --2- 172.21.15.106:0/2038757094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd0b80af4d0 0x7fd0b81f7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 >> 172.21.15.106:0/2038757094 conn(0x7fd0b8071b90 msgr2=0x7fd0b80b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 shutdown_connections 2023-11-24T06:13:37.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.644+0000 7fd0bd0bf700 1 -- 172.21.15.106:0/2038757094 wait complete. 2023-11-24T06:13:37.649 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 3 2023-11-24T06:13:37.659 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:37.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.777+0000 7f0518ec0700 1 Processor -- start 2023-11-24T06:13:37.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.777+0000 7f0518ec0700 1 -- start start 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f0518ec0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f05140b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f0518ec0700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140ae430 con 0x7f051415e080 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f0518ec0700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140ae710 con 0x7f051406c710 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f0518ec0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140af0b0 con 0x7f05140af4d0 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f051259c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f051415e080 0x7f051406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37842/0 (socket says 172.21.15.106:37842) 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.778+0000 7f051259c700 1 -- 172.21.15.106:0/11728207 learned_addr learned my addr 172.21.15.106:0/11728207 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071531749 0 0) 0x7f05140ae430 con 0x7f051415e080 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04fc0035b0 con 0x7f051415e080 2023-11-24T06:13:37.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0512d9d700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f05140b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3559563672 0 0) 0x7f04fc0035b0 con 0x7f051415e080 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 msgr2=0x7f05140b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f05140b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 >> v1:172.21.15.176:6789/0 conn(0x7f051406c710 legacy=0x7f051406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140ae9f0 con 0x7f051415e080 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f0508001670 con 0x7f051415e080 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 >> v1:172.21.15.106:6789/0 conn(0x7f051415e080 legacy=0x7f051406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc003a30 0x7f04fc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04fc004850 0x7f04fc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f04fc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05140af0b0 con 0x7f04fc004850 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc00bac0 con 0x7f04fc003a30 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04fc00bc80 con 0x7f05140af4d0 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04fc004850 0x7f04fc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f051259c700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc003a30 0x7f04fc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0512d9d700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f04fc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 -- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 msgr2=0x7f04fc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05140af4d0 0x7f04fc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 -- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc003a30 msgr2=0x7f04fc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc003a30 0x7f04fc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 -- 172.21.15.106:0/11728207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04fc0035b0 con 0x7f04fc004850 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.779+0000 7f0511d9b700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04fc004850 0x7f04fc004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0504007fd0 tx=0x7f04fc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6308841cfc12b536 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040052d0 con 0x7f04fc004850 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0504005470 con 0x7f04fc004850 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f051159a700 1 -- 172.21.15.106:0/11728207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05040038c0 con 0x7f04fc004850 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 -- 172.21.15.106:0/11728207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04fc004850 msgr2=0x7f04fc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 --2- 172.21.15.106:0/11728207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04fc004850 0x7f04fc004cd0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0504007fd0 tx=0x7f04fc005880 comp rx=0 tx=0).stop 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0512d9d700 1 -- 172.21.15.106:0/11728207 reap_dead start 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 -- 172.21.15.106:0/11728207 shutdown_connections 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 -- 172.21.15.106:0/11728207 >> 172.21.15.106:0/11728207 conn(0x7f0514071b90 msgr2=0x7f0514071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 -- 172.21.15.106:0/11728207 shutdown_connections 2023-11-24T06:13:37.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.780+0000 7f0518ec0700 1 -- 172.21.15.106:0/11728207 wait complete. 2023-11-24T06:13:37.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.781+0000 7f0518ec0700 1 Processor -- start 2023-11-24T06:13:37.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 -- start start 2023-11-24T06:13:37.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc004850 0x7f05141f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0514160c10 0x7f05141f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141f4820 con 0x7f0514156690 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514156c20 con 0x7f04fc004850 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0518ec0700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051415fe50 con 0x7f0514160c10 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0511d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0511d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57596/0 (socket says 172.21.15.106:57596) 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0511d9b700 1 -- 172.21.15.106:0/1827462271 learned_addr learned my addr 172.21.15.106:0/1827462271 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f051259c700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc004850 0x7f05141f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.782+0000 7f0512d9d700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0514160c10 0x7f05141f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 -- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0514160c10 msgr2=0x7f05141f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0514160c10 0x7f05141f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 -- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc004850 msgr2=0x7f05141f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc004850 0x7f05141f42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 -- 172.21.15.106:0/1827462271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0514160130 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0511d9b700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0047b0 tx=0x7f0504001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504007240 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040073a0 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0514160410 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504007730 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.783+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05141f1230 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.784+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140753f0 con 0x7f0514156690 2023-11-24T06:13:37.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.784+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0504003680 con 0x7f0514156690 2023-11-24T06:13:37.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.785+0000 7f0502ffd700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 0x7f04f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:37.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.785+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0504089dd0 con 0x7f0514156690 2023-11-24T06:13:37.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.785+0000 7f051259c700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 0x7f04f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:37.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.785+0000 7f051259c700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 0x7f04f406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0508001c90 tx=0x7f0508001b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:37.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.789+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0504055380 con 0x7f0514156690 2023-11-24T06:13:37.988 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.986+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0514067f60 con 0x7f0514156690 2023-11-24T06:13:37.989 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.987+0000 7f0502ffd700 1 -- 172.21.15.106:0/1827462271 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12874 (secure 0 0 0) 0x7f05040589a0 con 0x7f0514156690 2023-11-24T06:13:37.989 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:37.990 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":16,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:30.708325+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 msgr2=0x7f04f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 0x7f04f406d390 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0508001c90 tx=0x7f0508001b20 comp rx=0 tx=0).stop 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 msgr2=0x7f05141f0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f04fc0047b0 tx=0x7f0504001120 comp rx=0 tx=0).stop 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 shutdown_connections 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04f406aed0 0x7f04f406d390 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0514160c10 0x7f05141f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f04fc004850 0x7f05141f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 --2- 172.21.15.106:0/1827462271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0514156690 0x7f05141f0cf0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:37.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 >> 172.21.15.106:0/1827462271 conn(0x7f0514071b90 msgr2=0x7f051406f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:37.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 shutdown_connections 2023-11-24T06:13:37.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:37.989+0000 7f0518ec0700 1 -- 172.21.15.106:0/1827462271 wait complete. 2023-11-24T06:13:38.004 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:38.004 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:38.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.124+0000 7fc023989700 1 Processor -- start 2023-11-24T06:13:38.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.124+0000 7fc023989700 1 -- start start 2023-11-24T06:13:38.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc023989700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc023989700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc023989700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01c06b530 con 0x7fc01c0b3c60 2023-11-24T06:13:38.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc023989700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc01c0ae5e0 con 0x7fc01c15b370 2023-11-24T06:13:38.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc023989700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c15be30 con 0x7fc01c1587f0 2023-11-24T06:13:38.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc020f24700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc020f24700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:37838/0 (socket says 172.21.15.106:37838) 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc021725700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.125+0000 7fc020f24700 1 -- 172.21.15.106:0/3829091896 learned_addr learned my addr 172.21.15.106:0/3829091896 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc020f24700 1 -- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 msgr2=0x7fc01c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc020f24700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc020f24700 1 -- 172.21.15.106:0/3829091896 >> v1:172.21.15.176:6789/0 conn(0x7fc01c0b3c60 legacy=0x7fc01c0af060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc020f24700 1 -- 172.21.15.106:0/3829091896 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01c15c110 con 0x7fc01c15b370 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc013fff700 1 -- 172.21.15.106:0/3829091896 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121488944 0 0) 0x7fc01c06b530 con 0x7fc01c0b3c60 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc021725700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc020f24700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c15b370 0x7fc01c15b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098f0 tx=0x7fc00c009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89b9e1b36e3c7134 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc013fff700 1 -- 172.21.15.106:0/3829091896 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c011830 con 0x7fc01c15b370 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc013fff700 1 -- 172.21.15.106:0/3829091896 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00c011990 con 0x7fc01c15b370 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc013fff700 1 -- 172.21.15.106:0/3829091896 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00c011d20 con 0x7fc01c15b370 2023-11-24T06:13:38.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 -- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c15b370 msgr2=0x7fc01c15b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c15b370 0x7fc01c15b7f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0098f0 tx=0x7fc00c009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 -- 172.21.15.106:0/3829091896 shutdown_connections 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c06aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 --2- 172.21.15.106:0/3829091896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c15b370 0x7fc01c15b7f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.126+0000 7fc023989700 1 -- 172.21.15.106:0/3829091896 >> 172.21.15.106:0/3829091896 conn(0x7fc01c0d0bf0 msgr2=0x7fc01c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.127+0000 7fc023989700 1 -- 172.21.15.106:0/3829091896 shutdown_connections 2023-11-24T06:13:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.127+0000 7fc023989700 1 -- 172.21.15.106:0/3829091896 wait complete. 2023-11-24T06:13:38.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 Processor -- start 2023-11-24T06:13:38.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 -- start start 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c0b3c60 0x7fc01c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c09bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c147bb0 con 0x7fc01c15b370 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c09aaa0 con 0x7fc01c0b3c60 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.128+0000 7fc023989700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc01c09ad80 con 0x7fc01c1587f0 2023-11-24T06:13:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57610/0 (socket says 172.21.15.106:57610) 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 -- 172.21.15.106:0/2658019147 learned_addr learned my addr 172.21.15.106:0/2658019147 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021725700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c0b3c60 0x7fc01c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc020f24700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c09bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 -- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 msgr2=0x7fc01c09bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c09bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 -- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c0b3c60 msgr2=0x7fc01c147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c0b3c60 0x7fc01c147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 -- 172.21.15.106:0/2658019147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180094a0 con 0x7fc01c15b370 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc021f26700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc014001560 tx=0x7fc01400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014003e30 con 0x7fc01c15b370 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc014005070 con 0x7fc01c15b370 2023-11-24T06:13:38.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c009550 con 0x7fc01c15b370 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc014005420 con 0x7fc01c15b370 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.129+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01c09b340 con 0x7fc01c15b370 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.130+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc01c068fb0 con 0x7fc01c15b370 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.130+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc014005580 con 0x7fc01c15b370 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.131+0000 7fc011ffb700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 0x7fc00006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.131+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc014088940 con 0x7fc01c15b370 2023-11-24T06:13:38.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.131+0000 7fc021725700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 0x7fc00006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.131+0000 7fc021725700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 0x7fc00006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc018009d70 tx=0x7fc018009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.135+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc014053cc0 con 0x7fc01c15b370 2023-11-24T06:13:38.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.324+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc01c06ecc0 con 0x7fc01c15b370 2023-11-24T06:13:38.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.324+0000 7fc011ffb700 1 -- 172.21.15.106:0/2658019147 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc0140170a0 con 0x7fc01c15b370 2023-11-24T06:13:38.327 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 msgr2=0x7fc00006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 0x7fc00006d390 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc018009d70 tx=0x7fc018009210 comp rx=0 tx=0).stop 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 msgr2=0x7fc01c06b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc014001560 tx=0x7fc01400cb50 comp rx=0 tx=0).stop 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 shutdown_connections 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc00006aed0 0x7fc00006d390 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc01c15b370 0x7fc01c06b990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc01c0b3c60 0x7fc01c147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 --2- 172.21.15.106:0/2658019147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc01c1587f0 0x7fc01c09bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 >> 172.21.15.106:0/2658019147 conn(0x7fc01c0d0bf0 msgr2=0x7fc01c15df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 shutdown_connections 2023-11-24T06:13:38.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.326+0000 7fc023989700 1 -- 172.21.15.106:0/2658019147 wait complete. 2023-11-24T06:13:38.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:13:38.461 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.458+0000 7f68bb1d8700 1 Processor -- start 2023-11-24T06:13:38.477 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.458+0000 7f68bb1d8700 1 -- start start 2023-11-24T06:13:38.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68bb1d8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f68b40af4d0 0x7f68b40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68bb1d8700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40ae430 con 0x7f68b415e080 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68bb1d8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b40ae710 con 0x7f68b406c710 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68bb1d8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40af0b0 con 0x7f68b40af4d0 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b9775700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f68b40af4d0 0x7f68b40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b8f74700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f68b415e080 0x7f68b406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37876/0 (socket says 172.21.15.106:37876) 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b8f74700 1 -- 172.21.15.106:0/1124687558 learned_addr learned my addr 172.21.15.106:0/1124687558 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2784572833 0 0) 0x7f68b40ae430 con 0x7f68b415e080 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68a40035b0 con 0x7f68b415e080 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b9775700 1 -- 172.21.15.106:0/1124687558 >> v1:172.21.15.176:6789/0 conn(0x7f68b406c710 legacy=0x7f68b406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525208555 0 0) 0x7f68b40ae710 con 0x7f68b406c710 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b9775700 1 -- 172.21.15.106:0/1124687558 >> v1:172.21.15.106:6789/0 conn(0x7f68b415e080 legacy=0x7f68b406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.482 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b9775700 1 -- 172.21.15.106:0/1124687558 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b40ae9f0 con 0x7f68b40af4d0 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.459+0000 7f68b9775700 1 --2- 172.21.15.106:0/1124687558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b40af4d0 0x7f68b40b5050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009d90 tx=0x7f68ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02eec9610a47afb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00e070 con 0x7f68b40af4d0 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac00bb20 con 0x7f68b40af4d0 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68b37fe700 1 -- 172.21.15.106:0/1124687558 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac00bed0 con 0x7f68b40af4d0 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 -- 172.21.15.106:0/1124687558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b40af4d0 msgr2=0x7f68b40b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/1124687558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b40af4d0 0x7f68b40b5050 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f68ac009d90 tx=0x7f68ac00b330 comp rx=0 tx=0).stop 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 -- 172.21.15.106:0/1124687558 shutdown_connections 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/1124687558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b40af4d0 0x7f68b40b5050 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 -- 172.21.15.106:0/1124687558 >> 172.21.15.106:0/1124687558 conn(0x7f68b4071b90 msgr2=0x7f68b4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 -- 172.21.15.106:0/1124687558 shutdown_connections 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.460+0000 7f68bb1d8700 1 -- 172.21.15.106:0/1124687558 wait complete. 2023-11-24T06:13:38.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.461+0000 7f68bb1d8700 1 Processor -- start 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.461+0000 7f68bb1d8700 1 -- start start 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68b406c710 0x7f68b4153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68b40af4d0 0x7f68b4152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4154e60 con 0x7f68b415e080 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b40cd7a0 con 0x7f68b40af4d0 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68bb1d8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b4154b80 con 0x7f68b406c710 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68b9775700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68b9775700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57622/0 (socket says 172.21.15.106:57622) 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.462+0000 7f68b9775700 1 -- 172.21.15.106:0/2833983872 learned_addr learned my addr 172.21.15.106:0/2833983872 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 -- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68b406c710 msgr2=0x7f68b4153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68b406c710 0x7f68b4153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 -- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68b40af4d0 msgr2=0x7f68b4152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b3fff700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68b40af4d0 0x7f68b4152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68b40af4d0 0x7f68b4152730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 -- 172.21.15.106:0/2833983872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ac009a70 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b9775700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68ac014040 tx=0x7f68ac004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01b810 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ac020070 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b40cda60 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ac01bbb0 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.463+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b4154210 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.464+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b40753f0 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.464+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68ac01bd10 con 0x7f68b415e080 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.465+0000 7f68b17fa700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.465+0000 7f68b8f74700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.465+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f68ac022070 con 0x7f68b415e080 2023-11-24T06:13:38.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.465+0000 7f68b8f74700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 0x7f689806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fd0 tx=0x7f68a8007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.486 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.469+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f68ac05a620 con 0x7f68b415e080 2023-11-24T06:13:38.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.661+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f68b4067f60 con 0x7f68b415e080 2023-11-24T06:13:38.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.662+0000 7f68b17fa700 1 -- 172.21.15.106:0/2833983872 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f68ac05a1b0 con 0x7f68b415e080 2023-11-24T06:13:38.664 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:13:38.665 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-11-24T06:13:38.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.663+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 msgr2=0x7f689806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.663+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 0x7f689806d390 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f68a8007fd0 tx=0x7f68a8007980 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.663+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 msgr2=0x7f68b415a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.663+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f68ac014040 tx=0x7f68ac004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 shutdown_connections 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f68b415e080 0x7f68b415a6b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f68b406c710 0x7f68b4153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 --2- 172.21.15.106:0/2833983872 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f68b40af4d0 0x7f68b4152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 >> 172.21.15.106:0/2833983872 conn(0x7f68b4071b90 msgr2=0x7f68b40b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 shutdown_connections 2023-11-24T06:13:38.667 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.664+0000 7f68bb1d8700 1 -- 172.21.15.106:0/2833983872 wait complete. 2023-11-24T06:13:38.678 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:13:38.679 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:13:38.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.800+0000 7f147cec6700 1 Processor -- start 2023-11-24T06:13:38.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.800+0000 7f147cec6700 1 -- start start 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147cec6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147806e9c0 0x7f14780b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147cec6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f147806ee50 con 0x7f14780746a0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147cec6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14780b05c0 con 0x7f14780b01e0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147cec6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14781470a0 con 0x7f147806e9c0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f1475d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f14780746a0 0x7f147806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37890/0 (socket says 172.21.15.106:37890) 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f1475d9b700 1 -- 172.21.15.106:0/1816088273 learned_addr learned my addr 172.21.15.106:0/1816088273 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147806e9c0 0x7f14780b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 777845494 0 0) 0x7f147806ee50 con 0x7f14780746a0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14600035b0 con 0x7f14780746a0 2023-11-24T06:13:38.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2143295470 0 0) 0x7f14780b05c0 con 0x7f14780b01e0 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f147806ee50 con 0x7f14780b01e0 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2150168646 0 0) 0x7f14600035b0 con 0x7f14780746a0 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147806e9c0 msgr2=0x7f14780b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147806e9c0 0x7f14780b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 >> v1:172.21.15.176:6789/0 conn(0x7f14780b01e0 legacy=0x7f1478073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14780b4250 con 0x7f14780746a0 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f146c001670 con 0x7f14780746a0 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 >> v1:172.21.15.106:6789/0 conn(0x7f14780746a0 legacy=0x7f147806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.801+0000 7f147559a700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1460003bc0 0x7f1460003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1460004850 0x7f1460004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460005210 0x7f146000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14781470a0 con 0x7f1460003bc0 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146000c080 con 0x7f1460004850 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f146000c240 con 0x7f1460005210 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f147806e9c0 0x7f14780b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1460003bc0 0x7f1460003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f1475d9b700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1460004850 0x7f1460004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460005210 0x7f146000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 -- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460005210 msgr2=0x7f146000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460005210 0x7f146000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 -- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1460004850 msgr2=0x7f1460004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1460004850 0x7f1460004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 -- 172.21.15.106:0/1816088273 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14600035b0 con 0x7f1460003bc0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147659c700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1460003bc0 0x7f1460003fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1468001930 tx=0x7f1460005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66cf9ec1f644a76 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680052d0 con 0x7f1460003bc0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1468005430 con 0x7f1460003bc0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.802+0000 7f147559a700 1 -- 172.21.15.106:0/1816088273 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14680038c0 con 0x7f1460003bc0 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 -- 172.21.15.106:0/1816088273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1460003bc0 msgr2=0x7f1460003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 --2- 172.21.15.106:0/1816088273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1460003bc0 0x7f1460003fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1468001930 tx=0x7f1460005880 comp rx=0 tx=0).stop 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f1476d9d700 1 -- 172.21.15.106:0/1816088273 reap_dead start 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 -- 172.21.15.106:0/1816088273 shutdown_connections 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 -- 172.21.15.106:0/1816088273 >> 172.21.15.106:0/1816088273 conn(0x7f14780d0b40 msgr2=0x7f14780d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:38.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 -- 172.21.15.106:0/1816088273 shutdown_connections 2023-11-24T06:13:38.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.803+0000 7f147cec6700 1 -- 172.21.15.106:0/1816088273 wait complete. 2023-11-24T06:13:38.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.804+0000 7f147cec6700 1 Processor -- start 2023-11-24T06:13:38.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.804+0000 7f147cec6700 1 -- start start 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460003bc0 0x7f14781f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1478141f50 0x7f147813db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147813fe80 con 0x7f14781423d0 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1478140160 con 0x7f1478141f50 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147cec6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1478140440 con 0x7f1460003bc0 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57642/0 (socket says 172.21.15.106:57642) 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 -- 172.21.15.106:0/1143849030 learned_addr learned my addr 172.21.15.106:0/1143849030 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f147659c700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460003bc0 0x7f14781f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1475d9b700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1478141f50 0x7f147813db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 -- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460003bc0 msgr2=0x7f14781f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460003bc0 0x7f14781f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 -- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1478141f50 msgr2=0x7f147813db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1478141f50 0x7f147813db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 -- 172.21.15.106:0/1143849030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1478140720 con 0x7f14781423d0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.805+0000 7f1476d9d700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1478074fe0 tx=0x7f14700114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.806+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147000e070 con 0x7f14781423d0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.806+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470003c30 con 0x7f14781423d0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.806+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14781f70e0 con 0x7f14781423d0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.806+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470003de0 con 0x7f14781423d0 2023-11-24T06:13:38.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.806+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147813d190 con 0x7f14781423d0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.807+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14781617b0 con 0x7f14781423d0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.807+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1470011a10 con 0x7f14781423d0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.807+0000 7f1466ffd700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 0x7f145806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.807+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1470089760 con 0x7f14781423d0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.807+0000 7f147659c700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 0x7f145806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.808+0000 7f147659c700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 0x7f145806d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14781572b0 tx=0x7f1468009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:38.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:38.812+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1470054bf0 con 0x7f14781423d0 2023-11-24T06:13:39.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.002+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1478067f60 con 0x7f14781423d0 2023-11-24T06:13:39.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:39.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:13:39.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.907+0000 7f1466ffd700 1 -- 172.21.15.106:0/1143849030 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1470058210 con 0x7f14781423d0 2023-11-24T06:13:39.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.911+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 msgr2=0x7f145806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:39.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.911+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 0x7f145806d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f14781572b0 tx=0x7f1468009030 comp rx=0 tx=0).stop 2023-11-24T06:13:39.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.911+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 msgr2=0x7f147813e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:39.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.911+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1478074fe0 tx=0x7f14700114b0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 shutdown_connections 2023-11-24T06:13:39.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f145806aed0 0x7f145806d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14781423d0 0x7f147813e070 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1460003bc0 0x7f14781f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 --2- 172.21.15.106:0/1143849030 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1478141f50 0x7f147813db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 >> 172.21.15.106:0/1143849030 conn(0x7f14780d0b40 msgr2=0x7f14780b07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 shutdown_connections 2023-11-24T06:13:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:39.912+0000 7f147cec6700 1 -- 172.21.15.106:0/1143849030 wait complete. 2023-11-24T06:13:39.915 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2023-11-24T06:13:39.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:13:40.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.056+0000 7ff9b06d2700 1 Processor -- start 2023-11-24T06:13:40.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.056+0000 7ff9b06d2700 1 -- start start 2023-11-24T06:13:40.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9b06d2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9b06d2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 0x7ff9a80ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9b06d2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9a806ba50 con 0x7ff9a815e080 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9b06d2700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9a80d1200 con 0x7ff9a80b4310 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9b06d2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a815e460 con 0x7ff9a80ce430 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9adc6d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9adc6d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:37888/0 (socket says 172.21.15.106:37888) 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9adc6d700 1 -- 172.21.15.106:0/2659270981 learned_addr learned my addr 172.21.15.106:0/2659270981 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9ae46e700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff9a815e080 0x7ff9a80d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:60384/0 (socket says 172.21.15.106:60384) 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.057+0000 7ff9aec6f700 1 --2- 172.21.15.106:0/2659270981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 0x7ff9a80ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9aec6f700 1 -- 172.21.15.106:0/2659270981 >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 msgr2=0x7ff9a806bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:40.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9aec6f700 1 --2- 172.21.15.106:0/2659270981 >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9aec6f700 1 -- 172.21.15.106:0/2659270981 >> v1:172.21.15.176:6789/0 conn(0x7ff9a815e080 legacy=0x7ff9a80d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9aec6f700 1 -- 172.21.15.106:0/2659270981 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a806b120 con 0x7ff9a80ce430 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9adc6d700 1 --2- 172.21.15.106:0/2659270981 >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9aec6f700 1 --2- 172.21.15.106:0/2659270981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 0x7ff9a80ce8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009d90 tx=0x7ff9a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507c115e40c1b9f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9ad46c700 1 -- 172.21.15.106:0/2659270981 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000e070 con 0x7ff9a80ce430 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9ad46c700 1 -- 172.21.15.106:0/2659270981 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000bb20 con 0x7ff9a80ce430 2023-11-24T06:13:40.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9ad46c700 1 -- 172.21.15.106:0/2659270981 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0012430 con 0x7ff9a80ce430 2023-11-24T06:13:40.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2659270981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 msgr2=0x7ff9a80ce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2659270981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 0x7ff9a80ce8c0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0009d90 tx=0x7ff9a000b330 comp rx=0 tx=0).stop 2023-11-24T06:13:40.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2659270981 shutdown_connections 2023-11-24T06:13:40.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2659270981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a80ce430 0x7ff9a80ce8c0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2659270981 >> v2:172.21.15.176:3300/0 conn(0x7ff9a80b4310 0x7ff9a806bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.058+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2659270981 >> 172.21.15.106:0/2659270981 conn(0x7ff9a80b3780 msgr2=0x7ff9a80b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.059+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2659270981 shutdown_connections 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.059+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2659270981 wait complete. 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 Processor -- start 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 -- start start 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 0x7ff9a8160e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 0x7ff9a80b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80b4d00 con 0x7ff9a80ce430 2023-11-24T06:13:40.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a80b5880 con 0x7ff9a80b4310 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.060+0000 7ff9b06d2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a8160a20 con 0x7ff9a815e080 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57654/0 (socket says 172.21.15.106:57654) 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 -- 172.21.15.106:0/2915347590 learned_addr learned my addr 172.21.15.106:0/2915347590 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9aec6f700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 0x7ff9a80b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9ae46e700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 0x7ff9a8160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 -- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 msgr2=0x7ff9a80b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 0x7ff9a80b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 -- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 msgr2=0x7ff9a8160e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 0x7ff9a8160e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 -- 172.21.15.106:0/2915347590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998009550 con 0x7ff9a80ce430 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9aec6f700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 0x7ff9a80b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:40.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9ae46e700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 0x7ff9a8160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9adc6d700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff99800ebb0 tx=0x7ff99800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800c910 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99800ca70 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99800cde0 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a0009a70 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.061+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a80b5230 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.062+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80b5b60 con 0x7ff9a80ce430 2023-11-24T06:13:40.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.063+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff998013470 con 0x7ff9a80ce430 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.063+0000 7ff99effd700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 0x7ff98c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.063+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff9980894f0 con 0x7ff9a80ce430 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.063+0000 7ff9ae46e700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 0x7ff98c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:40.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.063+0000 7ff9ae46e700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 0x7ff98c06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4000f60 tx=0x7ff9a4007df0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:40.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.068+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff998054780 con 0x7ff9a80ce430 2023-11-24T06:13:40.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.259+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff9a8068fb0 con 0x7ff9a80ce430 2023-11-24T06:13:40.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.909+0000 7ff99effd700 1 -- 172.21.15.106:0/2915347590 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff998057da0 con 0x7ff9a80ce430 2023-11-24T06:13:40.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.913+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 msgr2=0x7ff98c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.914+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 0x7ff98c06d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4000f60 tx=0x7ff9a4007df0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.914+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 msgr2=0x7ff9a80b68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:40.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.914+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff99800ebb0 tx=0x7ff99800ef70 comp rx=0 tx=0).stop 2023-11-24T06:13:40.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 shutdown_connections 2023-11-24T06:13:40.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff98c06aed0 0x7ff98c06d390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff9a815e080 0x7ff9a80b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff9a80b4310 0x7ff9a8160e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 --2- 172.21.15.106:0/2915347590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff9a80ce430 0x7ff9a80b68b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:40.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 >> 172.21.15.106:0/2915347590 conn(0x7ff9a80b3780 msgr2=0x7ff9a80cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:40.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.915+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 shutdown_connections 2023-11-24T06:13:40.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:40.916+0000 7ff9b06d2700 1 -- 172.21.15.106:0/2915347590 wait complete. 2023-11-24T06:13:40.927 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2023-11-24T06:13:40.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:13:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.067+0000 7fcd22095700 1 Processor -- start 2023-11-24T06:13:41.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.067+0000 7fcd22095700 1 -- start start 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd22095700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcd1c06fab0 0x7fcd1c0ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd22095700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd1c15e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd22095700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd1c0b55a0 con 0x7fcd1c151c30 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd22095700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1c062900 con 0x7fcd1c06fab0 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd22095700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0b52c0 con 0x7fcd1c0cf0b0 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1b7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcd1c151c30 0x7fcd1c0ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37922/0 (socket says 172.21.15.106:37922) 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/3414444506 learned_addr learned my addr 172.21.15.106:0/3414444506 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 969440733 0 0) 0x7fcd1c0b55a0 con 0x7fcd1c151c30 2023-11-24T06:13:41.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd080035b0 con 0x7fcd1c151c30 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1bfff700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd1c15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1affd700 1 --2- 172.21.15.106:0/3414444506 >> v2:172.21.15.176:3300/0 conn(0x7fcd1c06fab0 0x7fcd1c0ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1867563697 0 0) 0x7fcd080035b0 con 0x7fcd1c151c30 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 msgr2=0x7fcd1c15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd1c15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 >> v2:172.21.15.176:3300/0 conn(0x7fcd1c06fab0 msgr2=0x7fcd1c0ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 --2- 172.21.15.106:0/3414444506 >> v2:172.21.15.176:3300/0 conn(0x7fcd1c06fab0 0x7fcd1c0ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c062340 con 0x7fcd1c151c30 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fcd04001670 con 0x7fcd1c151c30 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 >> v1:172.21.15.106:6789/0 conn(0x7fcd1c151c30 legacy=0x7fcd1c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.068+0000 7fcd1a7fc700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd08003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd08004850 0x7fcd08004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd08005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c062900 con 0x7fcd08003a00 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c0b52c0 con 0x7fcd08004850 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0800ba10 con 0x7fcd1c0cf0b0 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd08003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1bfff700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd08005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1affd700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd08004850 0x7fcd08004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 msgr2=0x7fcd08005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd08005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd08004850 msgr2=0x7fcd08004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:41.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd08004850 0x7fcd08004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/3414444506 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd080035b0 con 0x7fcd08003a00 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1bfff700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c0cf0b0 0x7fcd08005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1affd700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd08004850 0x7fcd08004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd08003e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c370 tx=0x7fcd08005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442344373e1b2963 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04007c60 con 0x7fcd08003a00 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd04005960 con 0x7fcd08003a00 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.069+0000 7fcd1a7fc700 1 -- 172.21.15.106:0/3414444506 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04005d10 con 0x7fcd08003a00 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 -- 172.21.15.106:0/3414444506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 msgr2=0x7fcd08003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 --2- 172.21.15.106:0/3414444506 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd08003e20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400c370 tx=0x7fcd08005880 comp rx=0 tx=0).stop 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd1bfff700 1 -- 172.21.15.106:0/3414444506 reap_dead start 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 -- 172.21.15.106:0/3414444506 shutdown_connections 2023-11-24T06:13:41.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 -- 172.21.15.106:0/3414444506 >> 172.21.15.106:0/3414444506 conn(0x7fcd1c0b2050 msgr2=0x7fcd1c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:41.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 -- 172.21.15.106:0/3414444506 shutdown_connections 2023-11-24T06:13:41.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.070+0000 7fcd22095700 1 -- 172.21.15.106:0/3414444506 wait complete. 2023-11-24T06:13:41.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.071+0000 7fcd22095700 1 Processor -- start 2023-11-24T06:13:41.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.071+0000 7fcd22095700 1 -- start start 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c14f390 0x7fcd1c0b3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 0x7fcd1c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e5de0 con 0x7fcd08003a00 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1f4e70 con 0x7fcd1c14f810 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1c1e5260 con 0x7fcd1c14f390 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57672/0 (socket says 172.21.15.106:57672) 2023-11-24T06:13:41.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/1635378641 learned_addr learned my addr 172.21.15.106:0/1635378641 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1affd700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c14f390 0x7fcd1c0b3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1bfff700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 0x7fcd1c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c14f390 msgr2=0x7fcd1c0b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c14f390 0x7fcd1c0b3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 msgr2=0x7fcd1c0b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 0x7fcd1c0b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 -- 172.21.15.106:0/1635378641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1c1e5540 con 0x7fcd08003a00 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1bfff700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 0x7fcd1c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd1b7fe700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd04011000 tx=0x7fcd04000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004870 con 0x7fcd08003a00 2023-11-24T06:13:41.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd040049d0 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1c1e5820 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd04004d80 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.072+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1c0adb80 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.073+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1c0add40 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.074+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd040070d0 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.074+0000 7fcd13fff700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 0x7fccfc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.074+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcd0408abb0 con 0x7fcd08003a00 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.074+0000 7fcd1affd700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 0x7fccfc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:41.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.075+0000 7fcd1affd700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 0x7fccfc06d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0ae770 tx=0x7fcd0c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:41.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.079+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd04055dd0 con 0x7fcd08003a00 2023-11-24T06:13:41.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.312+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcd1c068d90 con 0x7fcd08003a00 2023-11-24T06:13:41.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.927+0000 7fcd13fff700 1 -- 172.21.15.106:0/1635378641 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcd04007dc0 con 0x7fcd08003a00 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 msgr2=0x7fccfc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 0x7fccfc06d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c0ae770 tx=0x7fcd0c008040 comp rx=0 tx=0).stop 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 msgr2=0x7fcd1c0ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fcd04011000 tx=0x7fcd04000fe0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 shutdown_connections 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fccfc06aed0 0x7fccfc06d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcd1c14f810 0x7fcd1c0b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd08003a00 0x7fcd1c0ad640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 --2- 172.21.15.106:0/1635378641 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcd1c14f390 0x7fcd1c0b3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.934+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 >> 172.21.15.106:0/1635378641 conn(0x7fcd1c0b2050 msgr2=0x7fcd1c0b0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.935+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 shutdown_connections 2023-11-24T06:13:41.938 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:41.935+0000 7fcd22095700 1 -- 172.21.15.106:0/1635378641 wait complete. 2023-11-24T06:13:41.946 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 2 and data pool 3 2023-11-24T06:13:41.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:42.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.083+0000 7fd727916700 1 Processor -- start 2023-11-24T06:13:42.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.083+0000 7fd727916700 1 -- start start 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd72015e080 0x7fd7200b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7200af4d0 0x7fd7200afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd72006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7200af0b0 con 0x7fd7200af4d0 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72006c9f0 con 0x7fd72015e080 2023-11-24T06:13:42.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd727916700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7200b05a0 con 0x7fd72006c000 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7200af4d0 0x7fd7200afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7200af4d0 0x7fd7200afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57682/0 (socket says 172.21.15.106:57682) 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 -- 172.21.15.106:0/1305355119 learned_addr learned my addr 172.21.15.106:0/1305355119 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd7256b2700 1 --2- 172.21.15.106:0/1305355119 >> v2:172.21.15.176:3300/0 conn(0x7fd72015e080 0x7fd7200b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd725eb3700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd72006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 -- 172.21.15.106:0/1305355119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 msgr2=0x7fd72006c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd72006c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 -- 172.21.15.106:0/1305355119 >> v2:172.21.15.176:3300/0 conn(0x7fd72015e080 msgr2=0x7fd7200b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 --2- 172.21.15.106:0/1305355119 >> v2:172.21.15.176:3300/0 conn(0x7fd72015e080 0x7fd7200b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 -- 172.21.15.106:0/1305355119 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7200ae430 con 0x7fd7200af4d0 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd725eb3700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd72006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:42.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.084+0000 7fd724eb1700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd7200afb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd720072a90 tx=0x7fd71c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1132c4c9f36365e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd717fff700 1 -- 172.21.15.106:0/1305355119 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00b870 con 0x7fd7200af4d0 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd717fff700 1 -- 172.21.15.106:0/1305355119 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c00b9d0 con 0x7fd7200af4d0 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd717fff700 1 -- 172.21.15.106:0/1305355119 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c00bd60 con 0x7fd7200af4d0 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 -- 172.21.15.106:0/1305355119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 msgr2=0x7fd7200afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd7200afb90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd720072a90 tx=0x7fd71c009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 -- 172.21.15.106:0/1305355119 shutdown_connections 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd72006c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 --2- 172.21.15.106:0/1305355119 >> v2:172.21.15.176:3300/0 conn(0x7fd72015e080 0x7fd7200b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 --2- 172.21.15.106:0/1305355119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd7200afb90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 -- 172.21.15.106:0/1305355119 >> 172.21.15.106:0/1305355119 conn(0x7fd720071b90 msgr2=0x7fd720071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:42.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 -- 172.21.15.106:0/1305355119 shutdown_connections 2023-11-24T06:13:42.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.085+0000 7fd727916700 1 -- 172.21.15.106:0/1305355119 wait complete. 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.086+0000 7fd727916700 1 Processor -- start 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.086+0000 7fd727916700 1 -- start start 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd720141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd72015e080 0x7fd720154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd720142360 con 0x7fd7200af4d0 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd720158ed0 con 0x7fd72015e080 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd727916700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7201540a0 con 0x7fd72006c000 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd724eb1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd724eb1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57688/0 (socket says 172.21.15.106:57688) 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd724eb1700 1 -- 172.21.15.106:0/8836842 learned_addr learned my addr 172.21.15.106:0/8836842 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd725eb3700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd72015e080 0x7fd720154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd724eb1700 1 -- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 msgr2=0x7fd720141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.087+0000 7fd7256b2700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd720141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd724eb1700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd720141e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd724eb1700 1 -- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd72015e080 msgr2=0x7fd720154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd724eb1700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd72015e080 0x7fd720154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd724eb1700 1 -- 172.21.15.106:0/8836842 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd71c009550 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd724eb1700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c004540 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71c0036a0 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c003a50 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7201537b0 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.088+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7201611f0 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.089+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7200753f0 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.089+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd71c021070 con 0x7fd7200af4d0 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.090+0000 7fd715ffb700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 0x7fd70406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.090+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd71c08aca0 con 0x7fd7200af4d0 2023-11-24T06:13:42.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.090+0000 7fd7256b2700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 0x7fd70406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.090+0000 7fd7256b2700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 0x7fd70406d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd720151650 tx=0x7fd710008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.094+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd71c055d40 con 0x7fd7200af4d0 2023-11-24T06:13:42.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.287+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd720154210 con 0x7fd7200af4d0 2023-11-24T06:13:42.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.288+0000 7fd715ffb700 1 -- 172.21.15.106:0/8836842 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16542 (secure 0 0 0) 0x7fd71c029090 con 0x7fd7200af4d0 2023-11-24T06:13:42.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:42.291 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:41.313829+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:42.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 msgr2=0x7fd70406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 0x7fd70406d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd720151650 tx=0x7fd710008040 comp rx=0 tx=0).stop 2023-11-24T06:13:42.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 msgr2=0x7fd720154530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd71c000c00 tx=0x7fd71c004750 comp rx=0 tx=0).stop 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 shutdown_connections 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd70406aed0 0x7fd70406d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd72015e080 0x7fd720154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd72006c000 0x7fd720141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 --2- 172.21.15.106:0/8836842 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7200af4d0 0x7fd720154530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 >> 172.21.15.106:0/8836842 conn(0x7fd720071b90 msgr2=0x7fd7200d0260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 shutdown_connections 2023-11-24T06:13:42.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.290+0000 7fd727916700 1 -- 172.21.15.106:0/8836842 wait complete. 2023-11-24T06:13:42.305 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.423+0000 7f0900a04700 1 Processor -- start 2023-11-24T06:13:42.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.423+0000 7f0900a04700 1 -- start start 2023-11-24T06:13:42.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f0900a04700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc0b0ba0 0x7f08fc0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f0900a04700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f08fc15ee90 0x7f08fc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f0900a04700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0b2bd0 con 0x7f08fc0b0f80 2023-11-24T06:13:42.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f0900a04700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0b1fc0 con 0x7f08fc15ee90 2023-11-24T06:13:42.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f0900a04700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0b22a0 con 0x7f08fc0b0ba0 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f08fc15ee90 0x7f08fc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f9d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f08fc0b0f80 0x7f08fc0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37958/0 (socket says 172.21.15.106:37958) 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f9d9b700 1 -- 172.21.15.106:0/3367288167 learned_addr learned my addr 172.21.15.106:0/3367288167 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fa59c700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc0b0ba0 0x7f08fc0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 -- 172.21.15.106:0/3367288167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc0b0ba0 msgr2=0x7f08fc0af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc0b0ba0 0x7f08fc0af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 -- 172.21.15.106:0/3367288167 >> v1:172.21.15.106:6789/0 conn(0x7f08fc0b0f80 legacy=0x7f08fc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f959a700 1 -- 172.21.15.106:0/3367288167 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 805048074 0 0) 0x7f08fc0b2bd0 con 0x7f08fc0b0f80 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 -- 172.21.15.106:0/3367288167 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0b2580 con 0x7f08fc15ee90 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08fad9d700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc15ee90 0x7f08fc15b450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009d90 tx=0x7f08f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29fd835a5d7ff608 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f959a700 1 -- 172.21.15.106:0/3367288167 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400e070 con 0x7f08fc15ee90 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f959a700 1 -- 172.21.15.106:0/3367288167 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400bbd0 con 0x7f08fc15ee90 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.424+0000 7f08f959a700 1 -- 172.21.15.106:0/3367288167 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4012430 con 0x7f08fc15ee90 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 -- 172.21.15.106:0/3367288167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc15ee90 msgr2=0x7f08fc15b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc15ee90 0x7f08fc15b450 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009d90 tx=0x7f08f400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 -- 172.21.15.106:0/3367288167 shutdown_connections 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc15ee90 0x7f08fc15b450 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 --2- 172.21.15.106:0/3367288167 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc0b0ba0 0x7f08fc0af5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 -- 172.21.15.106:0/3367288167 >> 172.21.15.106:0/3367288167 conn(0x7f08fc0b57b0 msgr2=0x7f08fc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 -- 172.21.15.106:0/3367288167 shutdown_connections 2023-11-24T06:13:42.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.425+0000 7f0900a04700 1 -- 172.21.15.106:0/3367288167 wait complete. 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.426+0000 7f0900a04700 1 Processor -- start 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.426+0000 7f0900a04700 1 -- start start 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 0x7f08fc15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc15ee90 0x7f08fc0d0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0af770 con 0x7f08fc0b0f80 2023-11-24T06:13:42.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc15da80 con 0x7f08fc0b0ba0 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f0900a04700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0ad310 con 0x7f08fc15ee90 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57700/0 (socket says 172.21.15.106:57700) 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 -- 172.21.15.106:0/2801854719 learned_addr learned my addr 172.21.15.106:0/2801854719 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08fad9d700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc15ee90 0x7f08fc0d0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08fa59c700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 0x7f08fc15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 -- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc15ee90 msgr2=0x7f08fc0d0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc15ee90 0x7f08fc0d0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 -- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 msgr2=0x7f08fc15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 0x7f08fc15d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08f9d9b700 1 -- 172.21.15.106:0/2801854719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f4009a70 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.427+0000 7f08fa59c700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 0x7f08fc15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f08f9d9b700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08f00011e0 tx=0x7f08f000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0004c80 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0004e00 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc0ad5f0 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f0007310 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.428+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc0adbb0 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.429+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc067f60 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.429+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08f0007470 con 0x7f08fc0b0f80 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.429+0000 7f08eaffd700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 0x7f08dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.430+0000 7f08fa59c700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 0x7f08dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.430+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08f00892f0 con 0x7f08fc0b0f80 2023-11-24T06:13:42.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.430+0000 7f08fa59c700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 0x7f08dc06d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0b52d0 tx=0x7f08ec008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.434+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08f0054430 con 0x7f08fc0b0f80 2023-11-24T06:13:42.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.624+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08fc071f00 con 0x7f08fc0b0f80 2023-11-24T06:13:42.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.625+0000 7f08eaffd700 1 -- 172.21.15.106:0/2801854719 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f08f0057a50 con 0x7f08fc0b0f80 2023-11-24T06:13:42.628 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:42.628 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":19,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:41.313829+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 msgr2=0x7f08dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 0x7f08dc06d390 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f08fc0b52d0 tx=0x7f08ec008040 comp rx=0 tx=0).stop 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 msgr2=0x7f08fc0d0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f08f00011e0 tx=0x7f08f000cae0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 shutdown_connections 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08dc06aed0 0x7f08dc06d390 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08fc15ee90 0x7f08fc0d0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc0b0ba0 0x7f08fc15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 --2- 172.21.15.106:0/2801854719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc0b0f80 0x7f08fc0d0410 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 >> 172.21.15.106:0/2801854719 conn(0x7f08fc0b57b0 msgr2=0x7f08fc0cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:42.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 shutdown_connections 2023-11-24T06:13:42.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.627+0000 7f0900a04700 1 -- 172.21.15.106:0/2801854719 wait complete. 2023-11-24T06:13:42.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:13:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.762+0000 7f9b2fcc6700 1 Processor -- start 2023-11-24T06:13:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.763+0000 7f9b2fcc6700 1 -- start start 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.763+0000 7f9b2fcc6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9b2815e160 0x7f9b280b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.763+0000 7f9b2fcc6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 0x7f9b2806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.763+0000 7f9b2fcc6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b280b3c60 con 0x7f9b280afc90 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2fcc6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280b4500 con 0x7f9b2815e160 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2fcc6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b280b58c0 con 0x7f9b280746a0 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9b2815e160 0x7f9b280b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2d261700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9b280afc90 0x7f9b28073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37974/0 (socket says 172.21.15.106:37974) 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2d261700 1 -- 172.21.15.106:0/2056728128 learned_addr learned my addr 172.21.15.106:0/2056728128 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:42.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2e263700 1 --2- 172.21.15.106:0/2056728128 >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 0x7f9b2806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 -- 172.21.15.106:0/2056728128 >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 msgr2=0x7f9b2806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 --2- 172.21.15.106:0/2056728128 >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 0x7f9b2806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 -- 172.21.15.106:0/2056728128 >> v1:172.21.15.106:6789/0 conn(0x7f9b280afc90 legacy=0x7f9b28073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2ca60700 1 -- 172.21.15.106:0/2056728128 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819590295 0 0) 0x7f9b280b3c60 con 0x7f9b280afc90 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 -- 172.21.15.106:0/2056728128 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b280b0140 con 0x7f9b2815e160 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2e263700 1 --2- 172.21.15.106:0/2056728128 >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 0x7f9b2806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2da62700 1 --2- 172.21.15.106:0/2056728128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b2815e160 0x7f9b280b5da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b280d16e0 tx=0x7f9b18009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a348f6ef898a636 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2ca60700 1 -- 172.21.15.106:0/2056728128 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011830 con 0x7f9b2815e160 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2ca60700 1 -- 172.21.15.106:0/2056728128 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b18011990 con 0x7f9b2815e160 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.764+0000 7f9b2ca60700 1 -- 172.21.15.106:0/2056728128 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18011d20 con 0x7f9b2815e160 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/2056728128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b2815e160 msgr2=0x7f9b280b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/2056728128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b2815e160 0x7f9b280b5da0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9b280d16e0 tx=0x7f9b18009b20 comp rx=0 tx=0).stop 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/2056728128 shutdown_connections 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/2056728128 >> v2:172.21.15.176:3300/0 conn(0x7f9b280746a0 0x7f9b2806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/2056728128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b2815e160 0x7f9b280b5da0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/2056728128 >> 172.21.15.106:0/2056728128 conn(0x7f9b280d0bf0 msgr2=0x7f9b280d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/2056728128 shutdown_connections 2023-11-24T06:13:42.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.765+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/2056728128 wait complete. 2023-11-24T06:13:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.766+0000 7f9b2fcc6700 1 Processor -- start 2023-11-24T06:13:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.766+0000 7f9b2fcc6700 1 -- start start 2023-11-24T06:13:42.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b280746a0 0x7f9b28161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2815e160 0x7f9b281502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281f4e30 con 0x7f9b280afc90 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281f7db0 con 0x7f9b280746a0 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b281f8090 con 0x7f9b2815e160 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57714/0 (socket says 172.21.15.106:57714) 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 -- 172.21.15.106:0/673916667 learned_addr learned my addr 172.21.15.106:0/673916667 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2e263700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2815e160 0x7f9b281502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2da62700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b280746a0 0x7f9b28161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 -- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2815e160 msgr2=0x7f9b281502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2815e160 0x7f9b281502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 -- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b280746a0 msgr2=0x7f9b28161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b280746a0 0x7f9b28161c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 -- 172.21.15.106:0/673916667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180094a0 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2d261700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b240011e0 tx=0x7f9b2400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24004c80 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b24004e00 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b281f50c0 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.767+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b24007310 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.768+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2806ee10 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.768+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b281f8250 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.769+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9b24007470 con 0x7f9b280afc90 2023-11-24T06:13:42.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.769+0000 7f9b1e7fc700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:42.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.769+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b24089210 con 0x7f9b280afc90 2023-11-24T06:13:42.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.769+0000 7f9b2da62700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:42.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.770+0000 7f9b2da62700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 0x7f9b0c06d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b180090b0 tx=0x7f9b1801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:42.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:42.774+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9b281f8250 con 0x7f9b280afc90 2023-11-24T06:13:43.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.010+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9b281f8250 con 0x7f9b280afc90 2023-11-24T06:13:43.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.942+0000 7f9b1e7fc700 1 -- 172.21.15.106:0/673916667 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9b281f8250 con 0x7f9b280afc90 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 msgr2=0x7f9b0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 0x7f9b0c06d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9b180090b0 tx=0x7f9b1801c040 comp rx=0 tx=0).stop 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 msgr2=0x7f9b281f7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b240011e0 tx=0x7f9b2400ca30 comp rx=0 tx=0).stop 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 shutdown_connections 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9b0c06aed0 0x7f9b0c06d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9b2815e160 0x7f9b281502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9b280746a0 0x7f9b28161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.948 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 --2- 172.21.15.106:0/673916667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b280afc90 0x7f9b281f7330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 >> 172.21.15.106:0/673916667 conn(0x7f9b280d0bf0 msgr2=0x7f9b2815d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 shutdown_connections 2023-11-24T06:13:43.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:43.945+0000 7f9b2fcc6700 1 -- 172.21.15.106:0/673916667 wait complete. 2023-11-24T06:13:43.962 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:13:43.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:13:44.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.088+0000 7f2d1fb17700 1 Processor -- start 2023-11-24T06:13:44.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.088+0000 7f2d1fb17700 1 -- start start 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1fb17700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2d1815e160 0x7f2d180b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1fb17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180afc90 0x7f2d18073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1fb17700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d180b3c60 con 0x7f2d180744d0 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1fb17700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d180b4500 con 0x7f2d1815e160 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1fb17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d18074960 con 0x7f2d180afc90 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2d1815e160 0x7f2d180b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2d1815e160 0x7f2d180b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57722/0 (socket says 172.21.15.106:57722) 2023-11-24T06:13:44.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 -- 172.21.15.106:0/2857049035 learned_addr learned my addr 172.21.15.106:0/2857049035 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d0b2700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180afc90 0x7f2d18073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 -- 172.21.15.106:0/2857049035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180afc90 msgr2=0x7f2d18073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180afc90 0x7f2d18073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 -- 172.21.15.106:0/2857049035 >> v1:172.21.15.176:6789/0 conn(0x7f2d180744d0 legacy=0x7f2d1806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 -- 172.21.15.106:0/2857049035 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d180b58c0 con 0x7f2d1815e160 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1d8b3700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d1815e160 0x7f2d180b5da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098f0 tx=0x7f2d14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2330094640a227a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1c8b1700 1 -- 172.21.15.106:0/2857049035 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d14004230 con 0x7f2d1815e160 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1c8b1700 1 -- 172.21.15.106:0/2857049035 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d14004390 con 0x7f2d1815e160 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.089+0000 7f2d1c8b1700 1 -- 172.21.15.106:0/2857049035 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d140036a0 con 0x7f2d1815e160 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2857049035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d1815e160 msgr2=0x7f2d180b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d1815e160 0x7f2d180b5da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d140098f0 tx=0x7f2d14009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:44.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2857049035 shutdown_connections 2023-11-24T06:13:44.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d1815e160 0x7f2d180b5da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2857049035 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180afc90 0x7f2d18073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2857049035 >> 172.21.15.106:0/2857049035 conn(0x7f2d180d0bf0 msgr2=0x7f2d180d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:44.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2857049035 shutdown_connections 2023-11-24T06:13:44.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.090+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2857049035 wait complete. 2023-11-24T06:13:44.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.091+0000 7f2d1fb17700 1 Processor -- start 2023-11-24T06:13:44.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.091+0000 7f2d1fb17700 1 -- start start 2023-11-24T06:13:44.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180744d0 0x7f2d1814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d1815e160 0x7f2d1814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d181f38c0 con 0x7f2d180afc90 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1814dac0 con 0x7f2d1815e160 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1fb17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1814ac60 con 0x7f2d180744d0 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57730/0 (socket says 172.21.15.106:57730) 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 -- 172.21.15.106:0/2853890896 learned_addr learned my addr 172.21.15.106:0/2853890896 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d8b3700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180744d0 0x7f2d1814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1e0b4700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d1815e160 0x7f2d1814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 -- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180744d0 msgr2=0x7f2d1814e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180744d0 0x7f2d1814e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 -- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d1815e160 msgr2=0x7f2d1814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d1815e160 0x7f2d1814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 -- 172.21.15.106:0/2853890896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d14009550 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.092+0000 7f2d1d0b2700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800c7f0 tx=0x7f2d0800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d08004220 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d08004380 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d080036a0 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1814af40 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1814b500 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.093+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d18068fb0 con 0x7f2d180afc90 2023-11-24T06:13:44.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.094+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d08003800 con 0x7f2d180afc90 2023-11-24T06:13:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.094+0000 7f2d0e7fc700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 0x7f2cfc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.094+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d08089050 con 0x7f2d180afc90 2023-11-24T06:13:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.095+0000 7f2d1d8b3700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 0x7f2cfc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:44.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.095+0000 7f2d1d8b3700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 0x7f2cfc06d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009130 tx=0x7f2d14008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:44.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.099+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d08054190 con 0x7f2d180afc90 2023-11-24T06:13:44.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.336+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2d1806c140 con 0x7f2d180afc90 2023-11-24T06:13:44.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.943+0000 7f2d0e7fc700 1 -- 172.21.15.106:0/2853890896 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2d080577b0 con 0x7f2d180afc90 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 msgr2=0x7f2cfc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 0x7f2cfc06d390 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2d14009130 tx=0x7f2d14008030 comp rx=0 tx=0).stop 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 msgr2=0x7f2d1814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d0800c7f0 tx=0x7f2d0800cb00 comp rx=0 tx=0).stop 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 shutdown_connections 2023-11-24T06:13:44.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2cfc06aed0 0x7f2cfc06d390 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2d1815e160 0x7f2d1814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2d180744d0 0x7f2d1814e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 --2- 172.21.15.106:0/2853890896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2d180afc90 0x7f2d1814d580 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 >> 172.21.15.106:0/2853890896 conn(0x7f2d180d0bf0 msgr2=0x7f2d1806ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 shutdown_connections 2023-11-24T06:13:44.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:44.946+0000 7f2d1fb17700 1 -- 172.21.15.106:0/2853890896 wait complete. 2023-11-24T06:13:44.963 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:13:44.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:45.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 Processor -- start 2023-11-24T06:13:45.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 -- start start 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68815bdd0 0x7fe6881604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 0x7fe6880d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6880b22d0 con 0x7fe6880b3370 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6880b2f50 con 0x7fe68815bdd0 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ec97700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6880d2640 con 0x7fe6880d1c70 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.086+0000 7fe68ca33700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68815bdd0 0x7fe6881604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe68815bdd0 0x7fe6881604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57736/0 (socket says 172.21.15.106:57736) 2023-11-24T06:13:45.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 -- 172.21.15.106:0/492169382 learned_addr learned my addr 172.21.15.106:0/492169382 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68d234700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 0x7fe6880d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 -- 172.21.15.106:0/492169382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 msgr2=0x7fe6880d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 0x7fe6880d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 -- 172.21.15.106:0/492169382 >> v1:172.21.15.176:6789/0 conn(0x7fe6880b3370 legacy=0x7fe6880b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 -- 172.21.15.106:0/492169382 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6880b25b0 con 0x7fe68815bdd0 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68d234700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 0x7fe6880d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe68ca33700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe6881604e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0098f0 tx=0x7fe67c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e5be04eea6380e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe6877fe700 1 -- 172.21.15.106:0/492169382 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c004230 con 0x7fe68815bdd0 2023-11-24T06:13:45.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe6877fe700 1 -- 172.21.15.106:0/492169382 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c004390 con 0x7fe68815bdd0 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.087+0000 7fe6877fe700 1 -- 172.21.15.106:0/492169382 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0036a0 con 0x7fe68815bdd0 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 -- 172.21.15.106:0/492169382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 msgr2=0x7fe6881604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe6881604e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe67c0098f0 tx=0x7fe67c009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 -- 172.21.15.106:0/492169382 shutdown_connections 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880d1c70 0x7fe6880d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 --2- 172.21.15.106:0/492169382 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe6881604e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 -- 172.21.15.106:0/492169382 >> 172.21.15.106:0/492169382 conn(0x7fe6880731a0 msgr2=0x7fe68809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 -- 172.21.15.106:0/492169382 shutdown_connections 2023-11-24T06:13:45.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.088+0000 7fe68ec97700 1 -- 172.21.15.106:0/492169382 wait complete. 2023-11-24T06:13:45.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.089+0000 7fe68ec97700 1 Processor -- start 2023-11-24T06:13:45.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.089+0000 7fe68ec97700 1 -- start start 2023-11-24T06:13:45.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 0x7fe688154130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 0x7fe68815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815e720 con 0x7fe68815bdd0 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815ea00 con 0x7fe6880d1c70 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68815ece0 con 0x7fe6880b3370 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57746/0 (socket says 172.21.15.106:57746) 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 -- 172.21.15.106:0/4041920452 learned_addr learned my addr 172.21.15.106:0/4041920452 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ca33700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 0x7fe688154130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe687fff700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 0x7fe68815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 -- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 msgr2=0x7fe688154130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 0x7fe688154130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 -- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 msgr2=0x7fe68815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 0x7fe68815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 -- 172.21.15.106:0/4041920452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009550 con 0x7fe68815bdd0 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe687fff700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 0x7fe68815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ca33700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 0x7fe688154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68d234700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe68000cef0 tx=0x7fe68000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68000ae50 con 0x7fe68815bdd0 2023-11-24T06:13:45.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe680015440 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68815efc0 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6800157f0 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.090+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe688154670 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.091+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe688067f60 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.092+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe68000d430 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.092+0000 7fe6857fa700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 0x7fe66c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.092+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe680089c80 con 0x7fe68815bdd0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.092+0000 7fe68ca33700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 0x7fe66c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.093+0000 7fe68ca33700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 0x7fe66c06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009130 tx=0x7fe67c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.097+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe680054ca0 con 0x7fe68815bdd0 2023-11-24T06:13:45.297 INFO:tasks.ceph.mds.d.smithi176.stderr:2023-11-24T06:13:45.294+0000 7f3d3e144700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:13:45.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.327+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe6880b7c60 con 0x7fe68815bdd0 2023-11-24T06:13:45.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.328+0000 7fe6857fa700 1 -- 172.21.15.106:0/4041920452 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fe68001a070 con 0x7fe68815bdd0 2023-11-24T06:13:45.331 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:45.331 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 msgr2=0x7fe66c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 0x7fe66c06d390 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe67c009130 tx=0x7fe67c008030 comp rx=0 tx=0).stop 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 msgr2=0x7fe68806c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe68000cef0 tx=0x7fe68000a340 comp rx=0 tx=0).stop 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 shutdown_connections 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe66c06aed0 0x7fe66c06d390 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe68815bdd0 0x7fe68806c660 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe6880b3370 0x7fe688154130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 --2- 172.21.15.106:0/4041920452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe6880d1c70 0x7fe68815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 >> 172.21.15.106:0/4041920452 conn(0x7fe6880731a0 msgr2=0x7fe6880b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 shutdown_connections 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.330+0000 7fe68ec97700 1 -- 172.21.15.106:0/4041920452 wait complete. 2023-11-24T06:13:45.334 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:13:45.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:45.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.462+0000 7fd53fd9c700 1 Processor -- start 2023-11-24T06:13:45.465 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.462+0000 7fd53fd9c700 1 -- start start 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53fd9c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5381446a0 0x7fd5380b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53fd9c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5380adf00 0x7fd53806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53fd9c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5380af950 con 0x7fd53806c540 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53fd9c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd538144a80 con 0x7fd5380adf00 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53fd9c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53806c9b0 con 0x7fd5381446a0 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5380adf00 0x7fd53806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.467 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53e339700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd53806c540 0x7fd53806da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38016/0 (socket says 172.21.15.106:38016) 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53e339700 1 -- 172.21.15.106:0/1924686668 learned_addr learned my addr 172.21.15.106:0/1924686668 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53db38700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5381446a0 0x7fd5380b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 -- 172.21.15.106:0/1924686668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5381446a0 msgr2=0x7fd5380b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5381446a0 0x7fd5380b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 -- 172.21.15.106:0/1924686668 >> v1:172.21.15.106:6789/0 conn(0x7fd53806c540 legacy=0x7fd53806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 -- 172.21.15.106:0/1924686668 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380afc30 con 0x7fd5380adf00 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53cb36700 1 -- 172.21.15.106:0/1924686668 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 785104962 0 0) 0x7fd5380af950 con 0x7fd53806c540 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53d337700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5380adf00 0x7fd53806c000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd528009870 tx=0x7fd528009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3ee94cf9929b6e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53cb36700 1 -- 172.21.15.106:0/1924686668 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011830 con 0x7fd5380adf00 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53cb36700 1 -- 172.21.15.106:0/1924686668 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd528011990 con 0x7fd5380adf00 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.463+0000 7fd53cb36700 1 -- 172.21.15.106:0/1924686668 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd528011d20 con 0x7fd5380adf00 2023-11-24T06:13:45.468 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 -- 172.21.15.106:0/1924686668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5380adf00 msgr2=0x7fd53806c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5380adf00 0x7fd53806c000 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd528009870 tx=0x7fd528009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 -- 172.21.15.106:0/1924686668 shutdown_connections 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5381446a0 0x7fd5380b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/1924686668 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5380adf00 0x7fd53806c000 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 -- 172.21.15.106:0/1924686668 >> 172.21.15.106:0/1924686668 conn(0x7fd538071b90 msgr2=0x7fd538071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 -- 172.21.15.106:0/1924686668 shutdown_connections 2023-11-24T06:13:45.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.464+0000 7fd53fd9c700 1 -- 172.21.15.106:0/1924686668 wait complete. 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.465+0000 7fd53fd9c700 1 Processor -- start 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.465+0000 7fd53fd9c700 1 -- start start 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5380adf00 0x7fd538142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 0x7fd5380b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ce740 con 0x7fd53806c540 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5380ce8b0 con 0x7fd5381446a0 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53fd9c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53815abb0 con 0x7fd5380adf00 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57756/0 (socket says 172.21.15.106:57756) 2023-11-24T06:13:45.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 -- 172.21.15.106:0/2931300189 learned_addr learned my addr 172.21.15.106:0/2931300189 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 -- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5380adf00 msgr2=0x7fd538142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53e339700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 0x7fd5380b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53d337700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5380adf00 0x7fd538142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5380adf00 0x7fd538142650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 -- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 msgr2=0x7fd5380b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 0x7fd5380b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 -- 172.21.15.106:0/2931300189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5280094a0 con 0x7fd53806c540 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53e339700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 0x7fd5380b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.466+0000 7fd53db38700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd53400e810 tx=0x7fd53400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.467+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534013610 con 0x7fd53806c540 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.467+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd534013770 con 0x7fd53806c540 2023-11-24T06:13:45.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.467+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534013b20 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.467+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5381430f0 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.467+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5381436b0 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.468+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5380753f0 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.468+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd534013c80 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.468+0000 7fd52e7fc700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 0x7fd51c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.469+0000 7fd53d337700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 0x7fd51c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.469+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd534089270 con 0x7fd53806c540 2023-11-24T06:13:45.474 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.469+0000 7fd53d337700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 0x7fd51c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ae2e0 tx=0x7fd528008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.475 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.473+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd534054330 con 0x7fd53806c540 2023-11-24T06:13:45.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.662+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd538067f60 con 0x7fd53806c540 2023-11-24T06:13:45.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.663+0000 7fd52e7fc700 1 -- 172.21.15.106:0/2931300189 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fd534057950 con 0x7fd53806c540 2023-11-24T06:13:45.666 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:45.666 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 msgr2=0x7fd51c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 0x7fd51c06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd5380ae2e0 tx=0x7fd528008030 comp rx=0 tx=0).stop 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 msgr2=0x7fd53815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd53400e810 tx=0x7fd53400ebd0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 shutdown_connections 2023-11-24T06:13:45.668 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd51c06aed0 0x7fd51c06d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5381446a0 0x7fd5380b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd53806c540 0x7fd53815a670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 --2- 172.21.15.106:0/2931300189 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5380adf00 0x7fd538142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 >> 172.21.15.106:0/2931300189 conn(0x7fd538071b90 msgr2=0x7fd53815e710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 shutdown_connections 2023-11-24T06:13:45.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.665+0000 7fd53fd9c700 1 -- 172.21.15.106:0/2931300189 wait complete. 2023-11-24T06:13:45.680 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:13:45.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:45.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.796+0000 7f79f7291700 1 Processor -- start 2023-11-24T06:13:45.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.797+0000 7f79f7291700 1 -- start start 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.797+0000 7f79f7291700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79f006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.797+0000 7f79f7291700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00af950 con 0x7f79f01446a0 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.797+0000 7f79f7291700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79f00afc30 con 0x7f79f006c540 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.797+0000 7f79f7291700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0144a80 con 0x7f79f00adf00 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f502d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f79f01446a0 0x7f79f00b5ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38026/0 (socket says 172.21.15.106:38026) 2023-11-24T06:13:45.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f502d700 1 -- 172.21.15.106:0/3353089570 learned_addr learned my addr 172.21.15.106:0/3353089570 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297686661 0 0) 0x7f79f00af950 con 0x7f79f01446a0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79dc0035b0 con 0x7f79f01446a0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79f006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2564817685 0 0) 0x7f79dc0035b0 con 0x7f79f01446a0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 msgr2=0x7f79f006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79f006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 >> v1:172.21.15.176:6789/0 conn(0x7f79f006c540 legacy=0x7f79f00b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00aff10 con 0x7f79f01446a0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f79e0001670 con 0x7f79f01446a0 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 >> v1:172.21.15.106:6789/0 conn(0x7f79f01446a0 legacy=0x7f79f00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79dc003a30 0x7f79dc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79dc004850 0x7f79dc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79dc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0144a80 con 0x7f79dc004850 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc00bac0 con 0x7f79dc003a30 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc00bc80 con 0x7f79f00adf00 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79dc004850 0x7f79dc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f502d700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79dc003a30 0x7f79dc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f582e700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79dc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 -- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 msgr2=0x7f79dc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79dc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 -- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79dc003a30 msgr2=0x7f79dc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:45.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79dc003a30 0x7f79dc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f482c700 1 -- 172.21.15.106:0/3353089570 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc0035b0 con 0x7f79dc004850 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.798+0000 7f79f582e700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79f00adf00 0x7f79dc005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f482c700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79dc004850 0x7f79dc004cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79f006eef0 tx=0x7f79dc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee55900ead8f749 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00e6c0 con 0x7f79dc004850 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79ec00e820 con 0x7f79dc004850 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79e7fff700 1 -- 172.21.15.106:0/3353089570 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79ec00eb90 con 0x7f79dc004850 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 -- 172.21.15.106:0/3353089570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79dc004850 msgr2=0x7f79dc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 --2- 172.21.15.106:0/3353089570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79dc004850 0x7f79dc004cd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f79f006eef0 tx=0x7f79dc005880 comp rx=0 tx=0).stop 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f582e700 1 -- 172.21.15.106:0/3353089570 reap_dead start 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 -- 172.21.15.106:0/3353089570 shutdown_connections 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 -- 172.21.15.106:0/3353089570 >> 172.21.15.106:0/3353089570 conn(0x7f79f0071b90 msgr2=0x7f79f0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:45.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 -- 172.21.15.106:0/3353089570 shutdown_connections 2023-11-24T06:13:45.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.799+0000 7f79f7291700 1 -- 172.21.15.106:0/3353089570 wait complete. 2023-11-24T06:13:45.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 Processor -- start 2023-11-24T06:13:45.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 -- start start 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79dc004850 0x7f79f013a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79f0158080 0x7f79f0158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f0158a40 con 0x7f79f01e34b0 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e4e80 con 0x7f79f0158080 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f7291700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f01e4270 con 0x7f79dc004850 2023-11-24T06:13:45.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f582e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f582e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57780/0 (socket says 172.21.15.106:57780) 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.801+0000 7f79f582e700 1 -- 172.21.15.106:0/1287240709 learned_addr learned my addr 172.21.15.106:0/1287240709 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 -- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79dc004850 msgr2=0x7f79f013a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79dc004850 0x7f79f013a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f482c700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79f0158080 0x7f79f0158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 -- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79f0158080 msgr2=0x7f79f0158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79f0158080 0x7f79f0158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 -- 172.21.15.106:0/1287240709 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f01e4550 con 0x7f79f01e34b0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f582e700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f79f006d3f0 tx=0x7f79e800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8003e10 con 0x7f79f01e34b0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e80050d0 con 0x7f79f01e34b0 2023-11-24T06:13:45.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f01e4830 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8005480 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.802+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f013ad10 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.803+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f00753f0 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.803+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f79e80055e0 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.804+0000 7f79e5ffb700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 0x7f79d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.804+0000 7f79f502d700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 0x7f79d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.804+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e808b690 con 0x7f79f01e34b0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.804+0000 7f79f502d700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 0x7f79d406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79e0001c90 tx=0x7f79e0001b20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:45.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.808+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f79e80567d0 con 0x7f79f01e34b0 2023-11-24T06:13:45.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:45.995+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f79f00b04d0 con 0x7f79d406aed0 2023-11-24T06:13:46.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.003+0000 7f79e5ffb700 1 -- 172.21.15.106:0/1287240709 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264633 (secure 0 0 0) 0x7f79e0007e20 con 0x7f79d406aed0 2023-11-24T06:13:46.008 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 msgr2=0x7f79d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 0x7f79d406d390 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f79e0001c90 tx=0x7f79e0001b20 comp rx=0 tx=0).stop 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 msgr2=0x7f79f01e3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f79f006d3f0 tx=0x7f79e800ee70 comp rx=0 tx=0).stop 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 shutdown_connections 2023-11-24T06:13:46.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79d406aed0 0x7f79d406d390 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79f01e34b0 0x7f79f01e3930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f79dc004850 0x7f79f013a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 --2- 172.21.15.106:0/1287240709 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f79f0158080 0x7f79f0158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 >> 172.21.15.106:0/1287240709 conn(0x7f79f0071b90 msgr2=0x7f79f0141ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 shutdown_connections 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.006+0000 7f79f7291700 1 -- 172.21.15.106:0/1287240709 wait complete. 2023-11-24T06:13:46.012 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:13:46.020 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-24T06:13:45.687923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218808,"kb_used_data":2632,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755912,"statfs":{"total":773094113280,"available":772870053888,"internally_reserved":0,"allocated":2695168,"data_stored":1666061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778734"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951924+0000","last_change":"2023-11-24T06:13:41.947526+0000","last_active":"2023-11-24T06:13:41.951924+0000","last_peered":"2023-11-24T06:13:41.951924+0000","last_clean":"2023-11-24T06:13:41.951924+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:41.951924+0000","last_undegraded":"2023-11-24T06:13:41.951924+0000","last_fullsized":"2023-11-24T06:13:41.951924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.937676+0000","last_change":"2023-11-24T06:13:41.934747+0000","last_active":"2023-11-24T06:13:41.937676+0000","last_peered":"2023-11-24T06:13:41.937676+0000","last_clean":"2023-11-24T06:13:41.937676+0000","last_became_active":"2023-11-24T06:13:41.933914+0000","last_became_peered":"2023-11-24T06:13:41.933914+0000","last_unstale":"2023-11-24T06:13:41.937676+0000","last_undegraded":"2023-11-24T06:13:41.937676+0000","last_fullsized":"2023-11-24T06:13:41.937676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944862+0000","last_change":"2023-11-24T06:13:41.939402+0000","last_active":"2023-11-24T06:13:41.944862+0000","last_peered":"2023-11-24T06:13:41.944862+0000","last_clean":"2023-11-24T06:13:41.944862+0000","last_became_active":"2023-11-24T06:13:41.939116+0000","last_became_peered":"2023-11-24T06:13:41.939116+0000","last_unstale":"2023-11-24T06:13:41.944862+0000","last_undegraded":"2023-11-24T06:13:41.944862+0000","last_fullsized":"2023-11-24T06:13:41.944862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950899+0000","last_change":"2023-11-24T06:13:41.946934+0000","last_active":"2023-11-24T06:13:41.950899+0000","last_peered":"2023-11-24T06:13:41.950899+0000","last_clean":"2023-11-24T06:13:41.950899+0000","last_became_active":"2023-11-24T06:13:41.943823+0000","last_became_peered":"2023-11-24T06:13:41.943823+0000","last_unstale":"2023-11-24T06:13:41.950899+0000","last_undegraded":"2023-11-24T06:13:41.950899+0000","last_fullsized":"2023-11-24T06:13:41.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951954+0000","last_change":"2023-11-24T06:13:41.947399+0000","last_active":"2023-11-24T06:13:41.951954+0000","last_peered":"2023-11-24T06:13:41.951954+0000","last_clean":"2023-11-24T06:13:41.951954+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:41.951954+0000","last_undegraded":"2023-11-24T06:13:41.951954+0000","last_fullsized":"2023-11-24T06:13:41.951954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951366+0000","last_change":"2023-11-24T06:13:41.937172+0000","last_active":"2023-11-24T06:13:41.951366+0000","last_peered":"2023-11-24T06:13:41.951366+0000","last_clean":"2023-11-24T06:13:41.951366+0000","last_became_active":"2023-11-24T06:13:41.935849+0000","last_became_peered":"2023-11-24T06:13:41.935849+0000","last_unstale":"2023-11-24T06:13:41.951366+0000","last_undegraded":"2023-11-24T06:13:41.951366+0000","last_fullsized":"2023-11-24T06:13:41.951366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951114+0000","last_change":"2023-11-24T06:13:41.945826+0000","last_active":"2023-11-24T06:13:41.951114+0000","last_peered":"2023-11-24T06:13:41.951114+0000","last_clean":"2023-11-24T06:13:41.951114+0000","last_became_active":"2023-11-24T06:13:41.945194+0000","last_became_peered":"2023-11-24T06:13:41.945194+0000","last_unstale":"2023-11-24T06:13:41.951114+0000","last_undegraded":"2023-11-24T06:13:41.951114+0000","last_fullsized":"2023-11-24T06:13:41.951114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956854+0000","last_change":"2023-11-24T06:13:41.952679+0000","last_active":"2023-11-24T06:13:41.956854+0000","last_peered":"2023-11-24T06:13:41.956854+0000","last_clean":"2023-11-24T06:13:41.956854+0000","last_became_active":"2023-11-24T06:13:41.952160+0000","last_became_peered":"2023-11-24T06:13:41.952160+0000","last_unstale":"2023-11-24T06:13:41.956854+0000","last_undegraded":"2023-11-24T06:13:41.956854+0000","last_fullsized":"2023-11-24T06:13:41.956854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953654+0000","last_change":"2023-11-24T06:13:41.949930+0000","last_active":"2023-11-24T06:13:41.953654+0000","last_peered":"2023-11-24T06:13:41.953654+0000","last_clean":"2023-11-24T06:13:41.953654+0000","last_became_active":"2023-11-24T06:13:41.949654+0000","last_became_peered":"2023-11-24T06:13:41.949654+0000","last_unstale":"2023-11-24T06:13:41.953654+0000","last_undegraded":"2023-11-24T06:13:41.953654+0000","last_fullsized":"2023-11-24T06:13:41.953654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.947905+0000","last_change":"2023-11-24T06:13:41.944967+0000","last_active":"2023-11-24T06:13:41.947905+0000","last_peered":"2023-11-24T06:13:41.947905+0000","last_clean":"2023-11-24T06:13:41.947905+0000","last_became_active":"2023-11-24T06:13:41.944686+0000","last_became_peered":"2023-11-24T06:13:41.944686+0000","last_unstale":"2023-11-24T06:13:41.947905+0000","last_undegraded":"2023-11-24T06:13:41.947905+0000","last_fullsized":"2023-11-24T06:13:41.947905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946272+0000","last_change":"2023-11-24T06:13:41.938879+0000","last_active":"2023-11-24T06:13:41.946272+0000","last_peered":"2023-11-24T06:13:41.946272+0000","last_clean":"2023-11-24T06:13:41.946272+0000","last_became_active":"2023-11-24T06:13:41.938609+0000","last_became_peered":"2023-11-24T06:13:41.938609+0000","last_unstale":"2023-11-24T06:13:41.946272+0000","last_undegraded":"2023-11-24T06:13:41.946272+0000","last_fullsized":"2023-11-24T06:13:41.946272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.938425+0000","last_change":"2023-11-24T06:13:41.934572+0000","last_active":"2023-11-24T06:13:41.938425+0000","last_peered":"2023-11-24T06:13:41.938425+0000","last_clean":"2023-11-24T06:13:41.938425+0000","last_became_active":"2023-11-24T06:13:41.934367+0000","last_became_peered":"2023-11-24T06:13:41.934367+0000","last_unstale":"2023-11-24T06:13:41.938425+0000","last_undegraded":"2023-11-24T06:13:41.938425+0000","last_fullsized":"2023-11-24T06:13:41.938425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.038778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956689+0000","last_change":"2023-11-24T06:13:41.950738+0000","last_active":"2023-11-24T06:13:41.956689+0000","last_peered":"2023-11-24T06:13:41.956689+0000","last_clean":"2023-11-24T06:13:41.956689+0000","last_became_active":"2023-11-24T06:13:41.950177+0000","last_became_peered":"2023-11-24T06:13:41.950177+0000","last_unstale":"2023-11-24T06:13:41.956689+0000","last_undegraded":"2023-11-24T06:13:41.956689+0000","last_fullsized":"2023-11-24T06:13:41.956689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.942517+0000","last_change":"2023-11-24T06:13:41.934953+0000","last_active":"2023-11-24T06:13:41.942517+0000","last_peered":"2023-11-24T06:13:41.942517+0000","last_clean":"2023-11-24T06:13:41.942517+0000","last_became_active":"2023-11-24T06:13:41.934659+0000","last_became_peered":"2023-11-24T06:13:41.934659+0000","last_unstale":"2023-11-24T06:13:41.942517+0000","last_undegraded":"2023-11-24T06:13:41.942517+0000","last_fullsized":"2023-11-24T06:13:41.942517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.933892+0000","last_change":"2023-11-24T06:13:41.928498+0000","last_active":"2023-11-24T06:13:41.933892+0000","last_peered":"2023-11-24T06:13:41.933892+0000","last_clean":"2023-11-24T06:13:41.933892+0000","last_became_active":"2023-11-24T06:13:41.928189+0000","last_became_peered":"2023-11-24T06:13:41.928189+0000","last_unstale":"2023-11-24T06:13:41.933892+0000","last_undegraded":"2023-11-24T06:13:41.933892+0000","last_fullsized":"2023-11-24T06:13:41.933892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951071+0000","last_change":"2023-11-24T06:13:41.940907+0000","last_active":"2023-11-24T06:13:41.951071+0000","last_peered":"2023-11-24T06:13:41.951071+0000","last_clean":"2023-11-24T06:13:41.951071+0000","last_became_active":"2023-11-24T06:13:41.937993+0000","last_became_peered":"2023-11-24T06:13:41.937993+0000","last_unstale":"2023-11-24T06:13:41.951071+0000","last_undegraded":"2023-11-24T06:13:41.951071+0000","last_fullsized":"2023-11-24T06:13:41.951071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951010+0000","last_change":"2023-11-24T06:13:41.947880+0000","last_active":"2023-11-24T06:13:41.951010+0000","last_peered":"2023-11-24T06:13:41.951010+0000","last_clean":"2023-11-24T06:13:41.951010+0000","last_became_active":"2023-11-24T06:13:41.947592+0000","last_became_peered":"2023-11-24T06:13:41.947592+0000","last_unstale":"2023-11-24T06:13:41.951010+0000","last_undegraded":"2023-11-24T06:13:41.951010+0000","last_fullsized":"2023-11-24T06:13:41.951010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.949058+0000","last_change":"2023-11-24T06:13:41.947575+0000","last_active":"2023-11-24T06:13:41.949058+0000","last_peered":"2023-11-24T06:13:41.949058+0000","last_clean":"2023-11-24T06:13:41.949058+0000","last_became_active":"2023-11-24T06:13:41.947285+0000","last_became_peered":"2023-11-24T06:13:41.947285+0000","last_unstale":"2023-11-24T06:13:41.949058+0000","last_undegraded":"2023-11-24T06:13:41.949058+0000","last_fullsized":"2023-11-24T06:13:41.949058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951973+0000","last_change":"2023-11-24T06:13:41.948433+0000","last_active":"2023-11-24T06:13:41.951973+0000","last_peered":"2023-11-24T06:13:41.951973+0000","last_clean":"2023-11-24T06:13:41.951973+0000","last_became_active":"2023-11-24T06:13:41.947260+0000","last_became_peered":"2023-11-24T06:13:41.947260+0000","last_unstale":"2023-11-24T06:13:41.951973+0000","last_undegraded":"2023-11-24T06:13:41.951973+0000","last_fullsized":"2023-11-24T06:13:41.951973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953503+0000","last_change":"2023-11-24T06:13:40.934891+0000","last_active":"2023-11-24T06:13:41.953503+0000","last_peered":"2023-11-24T06:13:41.953503+0000","last_clean":"2023-11-24T06:13:41.953503+0000","last_became_active":"2023-11-24T06:13:40.934571+0000","last_became_peered":"2023-11-24T06:13:40.934571+0000","last_unstale":"2023-11-24T06:13:41.953503+0000","last_undegraded":"2023-11-24T06:13:41.953503+0000","last_fullsized":"2023-11-24T06:13:41.953503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956774+0000","last_change":"2023-11-24T06:13:41.951352+0000","last_active":"2023-11-24T06:13:41.956774+0000","last_peered":"2023-11-24T06:13:41.956774+0000","last_clean":"2023-11-24T06:13:41.956774+0000","last_became_active":"2023-11-24T06:13:41.950474+0000","last_became_peered":"2023-11-24T06:13:41.950474+0000","last_unstale":"2023-11-24T06:13:41.956774+0000","last_undegraded":"2023-11-24T06:13:41.956774+0000","last_fullsized":"2023-11-24T06:13:41.956774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950427+0000","last_change":"2023-11-24T06:13:40.928009+0000","last_active":"2023-11-24T06:13:41.950427+0000","last_peered":"2023-11-24T06:13:41.950427+0000","last_clean":"2023-11-24T06:13:41.950427+0000","last_became_active":"2023-11-24T06:13:40.927708+0000","last_became_peered":"2023-11-24T06:13:40.927708+0000","last_unstale":"2023-11-24T06:13:41.950427+0000","last_undegraded":"2023-11-24T06:13:41.950427+0000","last_fullsized":"2023-11-24T06:13:41.950427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944659+0000","last_change":"2023-11-24T06:13:41.940330+0000","last_active":"2023-11-24T06:13:41.944659+0000","last_peered":"2023-11-24T06:13:41.944659+0000","last_clean":"2023-11-24T06:13:41.944659+0000","last_became_active":"2023-11-24T06:13:41.940009+0000","last_became_peered":"2023-11-24T06:13:41.940009+0000","last_unstale":"2023-11-24T06:13:41.944659+0000","last_undegraded":"2023-11-24T06:13:41.944659+0000","last_fullsized":"2023-11-24T06:13:41.944659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951097+0000","last_change":"2023-11-24T06:13:40.934975+0000","last_active":"2023-11-24T06:13:41.951097+0000","last_peered":"2023-11-24T06:13:41.951097+0000","last_clean":"2023-11-24T06:13:41.951097+0000","last_became_active":"2023-11-24T06:13:40.934687+0000","last_became_peered":"2023-11-24T06:13:40.934687+0000","last_unstale":"2023-11-24T06:13:41.951097+0000","last_undegraded":"2023-11-24T06:13:41.951097+0000","last_fullsized":"2023-11-24T06:13:41.951097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:14.621591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950728+0000","last_change":"2023-11-24T06:13:41.942453+0000","last_active":"2023-11-24T06:13:41.950728+0000","last_peered":"2023-11-24T06:13:41.950728+0000","last_clean":"2023-11-24T06:13:41.950728+0000","last_became_active":"2023-11-24T06:13:41.942179+0000","last_became_peered":"2023-11-24T06:13:41.942179+0000","last_unstale":"2023-11-24T06:13:41.950728+0000","last_undegraded":"2023-11-24T06:13:41.950728+0000","last_fullsized":"2023-11-24T06:13:41.950728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952530+0000","last_change":"2023-11-24T06:13:40.934902+0000","last_active":"2023-11-24T06:13:41.952530+0000","last_peered":"2023-11-24T06:13:41.952530+0000","last_clean":"2023-11-24T06:13:41.952530+0000","last_became_active":"2023-11-24T06:13:40.934610+0000","last_became_peered":"2023-11-24T06:13:40.934610+0000","last_unstale":"2023-11-24T06:13:41.952530+0000","last_undegraded":"2023-11-24T06:13:41.952530+0000","last_fullsized":"2023-11-24T06:13:41.952530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.959415+0000","last_change":"2023-11-24T06:13:41.954577+0000","last_active":"2023-11-24T06:13:41.959415+0000","last_peered":"2023-11-24T06:13:41.959415+0000","last_clean":"2023-11-24T06:13:41.959415+0000","last_became_active":"2023-11-24T06:13:41.954291+0000","last_became_peered":"2023-11-24T06:13:41.954291+0000","last_unstale":"2023-11-24T06:13:41.959415+0000","last_undegraded":"2023-11-24T06:13:41.959415+0000","last_fullsized":"2023-11-24T06:13:41.959415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952846+0000","last_change":"2023-11-24T06:13:40.934796+0000","last_active":"2023-11-24T06:13:41.952846+0000","last_peered":"2023-11-24T06:13:41.952846+0000","last_clean":"2023-11-24T06:13:41.952846+0000","last_became_active":"2023-11-24T06:13:40.934484+0000","last_became_peered":"2023-11-24T06:13:40.934484+0000","last_unstale":"2023-11-24T06:13:41.952846+0000","last_undegraded":"2023-11-24T06:13:41.952846+0000","last_fullsized":"2023-11-24T06:13:41.952846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:49.659223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.938689+0000","last_change":"2023-11-24T06:13:41.935058+0000","last_active":"2023-11-24T06:13:41.938689+0000","last_peered":"2023-11-24T06:13:41.938689+0000","last_clean":"2023-11-24T06:13:41.938689+0000","last_became_active":"2023-11-24T06:13:41.934769+0000","last_became_peered":"2023-11-24T06:13:41.934769+0000","last_unstale":"2023-11-24T06:13:41.938689+0000","last_undegraded":"2023-11-24T06:13:41.938689+0000","last_fullsized":"2023-11-24T06:13:41.938689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955135+0000","last_change":"2023-11-24T06:13:40.921881+0000","last_active":"2023-11-24T06:13:41.955135+0000","last_peered":"2023-11-24T06:13:41.955135+0000","last_clean":"2023-11-24T06:13:41.955135+0000","last_became_active":"2023-11-24T06:13:40.921653+0000","last_became_peered":"2023-11-24T06:13:40.921653+0000","last_unstale":"2023-11-24T06:13:41.955135+0000","last_undegraded":"2023-11-24T06:13:41.955135+0000","last_fullsized":"2023-11-24T06:13:41.955135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:42.082565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944742+0000","last_change":"2023-11-24T06:13:41.941156+0000","last_active":"2023-11-24T06:13:41.944742+0000","last_peered":"2023-11-24T06:13:41.944742+0000","last_clean":"2023-11-24T06:13:41.944742+0000","last_became_active":"2023-11-24T06:13:41.940843+0000","last_became_peered":"2023-11-24T06:13:41.940843+0000","last_unstale":"2023-11-24T06:13:41.944742+0000","last_undegraded":"2023-11-24T06:13:41.944742+0000","last_fullsized":"2023-11-24T06:13:41.944742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.932893+0000","last_change":"2023-11-24T06:13:40.926211+0000","last_active":"2023-11-24T06:13:41.932893+0000","last_peered":"2023-11-24T06:13:41.932893+0000","last_clean":"2023-11-24T06:13:41.932893+0000","last_became_active":"2023-11-24T06:13:40.925909+0000","last_became_peered":"2023-11-24T06:13:40.925909+0000","last_unstale":"2023-11-24T06:13:41.932893+0000","last_undegraded":"2023-11-24T06:13:41.932893+0000","last_fullsized":"2023-11-24T06:13:41.932893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944907+0000","last_change":"2023-11-24T06:13:41.938794+0000","last_active":"2023-11-24T06:13:41.944907+0000","last_peered":"2023-11-24T06:13:41.944907+0000","last_clean":"2023-11-24T06:13:41.944907+0000","last_became_active":"2023-11-24T06:13:41.938527+0000","last_became_peered":"2023-11-24T06:13:41.938527+0000","last_unstale":"2023-11-24T06:13:41.944907+0000","last_undegraded":"2023-11-24T06:13:41.944907+0000","last_fullsized":"2023-11-24T06:13:41.944907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931579+0000","last_change":"2023-11-24T06:13:40.933121+0000","last_active":"2023-11-24T06:13:41.931579+0000","last_peered":"2023-11-24T06:13:41.931579+0000","last_clean":"2023-11-24T06:13:41.931579+0000","last_became_active":"2023-11-24T06:13:40.932862+0000","last_became_peered":"2023-11-24T06:13:40.932862+0000","last_unstale":"2023-11-24T06:13:41.931579+0000","last_undegraded":"2023-11-24T06:13:41.931579+0000","last_fullsized":"2023-11-24T06:13:41.931579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954079+0000","last_change":"2023-11-24T06:13:41.946170+0000","last_active":"2023-11-24T06:13:41.954079+0000","last_peered":"2023-11-24T06:13:41.954079+0000","last_clean":"2023-11-24T06:13:41.954079+0000","last_became_active":"2023-11-24T06:13:41.943707+0000","last_became_peered":"2023-11-24T06:13:41.943707+0000","last_unstale":"2023-11-24T06:13:41.954079+0000","last_undegraded":"2023-11-24T06:13:41.954079+0000","last_fullsized":"2023-11-24T06:13:41.954079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.928311+0000","last_change":"2023-11-24T06:13:40.931003+0000","last_active":"2023-11-24T06:13:41.928311+0000","last_peered":"2023-11-24T06:13:41.928311+0000","last_clean":"2023-11-24T06:13:41.928311+0000","last_became_active":"2023-11-24T06:13:40.930726+0000","last_became_peered":"2023-11-24T06:13:40.930726+0000","last_unstale":"2023-11-24T06:13:41.928311+0000","last_undegraded":"2023-11-24T06:13:41.928311+0000","last_fullsized":"2023-11-24T06:13:41.928311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954687+0000","last_change":"2023-11-24T06:13:41.953367+0000","last_active":"2023-11-24T06:13:41.954687+0000","last_peered":"2023-11-24T06:13:41.954687+0000","last_clean":"2023-11-24T06:13:41.954687+0000","last_became_active":"2023-11-24T06:13:41.952985+0000","last_became_peered":"2023-11-24T06:13:41.952985+0000","last_unstale":"2023-11-24T06:13:41.954687+0000","last_undegraded":"2023-11-24T06:13:41.954687+0000","last_fullsized":"2023-11-24T06:13:41.954687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930898+0000","last_change":"2023-11-24T06:13:40.932963+0000","last_active":"2023-11-24T06:13:41.930898+0000","last_peered":"2023-11-24T06:13:41.930898+0000","last_clean":"2023-11-24T06:13:41.930898+0000","last_became_active":"2023-11-24T06:13:40.932634+0000","last_became_peered":"2023-11-24T06:13:40.932634+0000","last_unstale":"2023-11-24T06:13:41.930898+0000","last_undegraded":"2023-11-24T06:13:41.930898+0000","last_fullsized":"2023-11-24T06:13:41.930898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944633+0000","last_change":"2023-11-24T06:13:41.939776+0000","last_active":"2023-11-24T06:13:41.944633+0000","last_peered":"2023-11-24T06:13:41.944633+0000","last_clean":"2023-11-24T06:13:41.944633+0000","last_became_active":"2023-11-24T06:13:41.939488+0000","last_became_peered":"2023-11-24T06:13:41.939488+0000","last_unstale":"2023-11-24T06:13:41.944633+0000","last_undegraded":"2023-11-24T06:13:41.944633+0000","last_fullsized":"2023-11-24T06:13:41.944633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954402+0000","last_change":"2023-11-24T06:13:40.931993+0000","last_active":"2023-11-24T06:13:41.954402+0000","last_peered":"2023-11-24T06:13:41.954402+0000","last_clean":"2023-11-24T06:13:41.954402+0000","last_became_active":"2023-11-24T06:13:40.931611+0000","last_became_peered":"2023-11-24T06:13:40.931611+0000","last_unstale":"2023-11-24T06:13:41.954402+0000","last_undegraded":"2023-11-24T06:13:41.954402+0000","last_fullsized":"2023-11-24T06:13:41.954402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955102+0000","last_change":"2023-11-24T06:13:41.948915+0000","last_active":"2023-11-24T06:13:41.955102+0000","last_peered":"2023-11-24T06:13:41.955102+0000","last_clean":"2023-11-24T06:13:41.955102+0000","last_became_active":"2023-11-24T06:13:41.948645+0000","last_became_peered":"2023-11-24T06:13:41.948645+0000","last_unstale":"2023-11-24T06:13:41.955102+0000","last_undegraded":"2023-11-24T06:13:41.955102+0000","last_fullsized":"2023-11-24T06:13:41.955102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:30.383021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.962144+0000","last_change":"2023-11-24T06:13:40.926099+0000","last_active":"2023-11-24T06:13:41.962144+0000","last_peered":"2023-11-24T06:13:41.962144+0000","last_clean":"2023-11-24T06:13:41.962144+0000","last_became_active":"2023-11-24T06:13:40.925868+0000","last_became_peered":"2023-11-24T06:13:40.925868+0000","last_unstale":"2023-11-24T06:13:41.962144+0000","last_undegraded":"2023-11-24T06:13:41.962144+0000","last_fullsized":"2023-11-24T06:13:41.962144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951949+0000","last_change":"2023-11-24T06:13:41.948132+0000","last_active":"2023-11-24T06:13:41.951949+0000","last_peered":"2023-11-24T06:13:41.951949+0000","last_clean":"2023-11-24T06:13:41.951949+0000","last_became_active":"2023-11-24T06:13:41.947078+0000","last_became_peered":"2023-11-24T06:13:41.947078+0000","last_unstale":"2023-11-24T06:13:41.951949+0000","last_undegraded":"2023-11-24T06:13:41.951949+0000","last_fullsized":"2023-11-24T06:13:41.951949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955760+0000","last_change":"2023-11-24T06:13:40.929234+0000","last_active":"2023-11-24T06:13:41.955760+0000","last_peered":"2023-11-24T06:13:41.955760+0000","last_clean":"2023-11-24T06:13:41.955760+0000","last_became_active":"2023-11-24T06:13:40.929029+0000","last_became_peered":"2023-11-24T06:13:40.929029+0000","last_unstale":"2023-11-24T06:13:41.955760+0000","last_undegraded":"2023-11-24T06:13:41.955760+0000","last_fullsized":"2023-11-24T06:13:41.955760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.948759+0000","last_change":"2023-11-24T06:13:41.948004+0000","last_active":"2023-11-24T06:13:41.948759+0000","last_peered":"2023-11-24T06:13:41.948759+0000","last_clean":"2023-11-24T06:13:41.948759+0000","last_became_active":"2023-11-24T06:13:41.947739+0000","last_became_peered":"2023-11-24T06:13:41.947739+0000","last_unstale":"2023-11-24T06:13:41.948759+0000","last_undegraded":"2023-11-24T06:13:41.948759+0000","last_fullsized":"2023-11-24T06:13:41.948759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931847+0000","last_change":"2023-11-24T06:13:40.930439+0000","last_active":"2023-11-24T06:13:41.931847+0000","last_peered":"2023-11-24T06:13:41.931847+0000","last_clean":"2023-11-24T06:13:41.931847+0000","last_became_active":"2023-11-24T06:13:40.930080+0000","last_became_peered":"2023-11-24T06:13:40.930080+0000","last_unstale":"2023-11-24T06:13:41.931847+0000","last_undegraded":"2023-11-24T06:13:41.931847+0000","last_fullsized":"2023-11-24T06:13:41.931847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951975+0000","last_change":"2023-11-24T06:13:41.947175+0000","last_active":"2023-11-24T06:13:41.951975+0000","last_peered":"2023-11-24T06:13:41.951975+0000","last_clean":"2023-11-24T06:13:41.951975+0000","last_became_active":"2023-11-24T06:13:41.946843+0000","last_became_peered":"2023-11-24T06:13:41.946843+0000","last_unstale":"2023-11-24T06:13:41.951975+0000","last_undegraded":"2023-11-24T06:13:41.951975+0000","last_fullsized":"2023-11-24T06:13:41.951975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.928189+0000","last_change":"2023-11-24T06:13:40.921437+0000","last_active":"2023-11-24T06:13:41.928189+0000","last_peered":"2023-11-24T06:13:41.928189+0000","last_clean":"2023-11-24T06:13:41.928189+0000","last_became_active":"2023-11-24T06:13:40.921152+0000","last_became_peered":"2023-11-24T06:13:40.921152+0000","last_unstale":"2023-11-24T06:13:41.928189+0000","last_undegraded":"2023-11-24T06:13:41.928189+0000","last_fullsized":"2023-11-24T06:13:41.928189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946307+0000","last_change":"2023-11-24T06:13:41.936911+0000","last_active":"2023-11-24T06:13:41.946307+0000","last_peered":"2023-11-24T06:13:41.946307+0000","last_clean":"2023-11-24T06:13:41.946307+0000","last_became_active":"2023-11-24T06:13:41.936435+0000","last_became_peered":"2023-11-24T06:13:41.936435+0000","last_unstale":"2023-11-24T06:13:41.946307+0000","last_undegraded":"2023-11-24T06:13:41.946307+0000","last_fullsized":"2023-11-24T06:13:41.946307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955161+0000","last_change":"2023-11-24T06:13:40.931092+0000","last_active":"2023-11-24T06:13:41.955161+0000","last_peered":"2023-11-24T06:13:41.955161+0000","last_clean":"2023-11-24T06:13:41.955161+0000","last_became_active":"2023-11-24T06:13:40.930714+0000","last_became_peered":"2023-11-24T06:13:40.930714+0000","last_unstale":"2023-11-24T06:13:41.955161+0000","last_undegraded":"2023-11-24T06:13:41.955161+0000","last_fullsized":"2023-11-24T06:13:41.955161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951139+0000","last_change":"2023-11-24T06:13:41.946022+0000","last_active":"2023-11-24T06:13:41.951139+0000","last_peered":"2023-11-24T06:13:41.951139+0000","last_clean":"2023-11-24T06:13:41.951139+0000","last_became_active":"2023-11-24T06:13:41.945555+0000","last_became_peered":"2023-11-24T06:13:41.945555+0000","last_unstale":"2023-11-24T06:13:41.951139+0000","last_undegraded":"2023-11-24T06:13:41.951139+0000","last_fullsized":"2023-11-24T06:13:41.951139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954866+0000","last_change":"2023-11-24T06:13:40.928444+0000","last_active":"2023-11-24T06:13:41.954866+0000","last_peered":"2023-11-24T06:13:41.954866+0000","last_clean":"2023-11-24T06:13:41.954866+0000","last_became_active":"2023-11-24T06:13:40.928116+0000","last_became_peered":"2023-11-24T06:13:40.928116+0000","last_unstale":"2023-11-24T06:13:41.954866+0000","last_undegraded":"2023-11-24T06:13:41.954866+0000","last_fullsized":"2023-11-24T06:13:41.954866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956537+0000","last_change":"2023-11-24T06:13:41.952432+0000","last_active":"2023-11-24T06:13:41.956537+0000","last_peered":"2023-11-24T06:13:41.956537+0000","last_clean":"2023-11-24T06:13:41.956537+0000","last_became_active":"2023-11-24T06:13:41.952182+0000","last_became_peered":"2023-11-24T06:13:41.952182+0000","last_unstale":"2023-11-24T06:13:41.956537+0000","last_undegraded":"2023-11-24T06:13:41.956537+0000","last_fullsized":"2023-11-24T06:13:41.956537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.924483+0000","last_change":"2023-11-24T06:13:40.929215+0000","last_active":"2023-11-24T06:13:41.924483+0000","last_peered":"2023-11-24T06:13:41.924483+0000","last_clean":"2023-11-24T06:13:41.924483+0000","last_became_active":"2023-11-24T06:13:40.928931+0000","last_became_peered":"2023-11-24T06:13:40.928931+0000","last_unstale":"2023-11-24T06:13:41.924483+0000","last_undegraded":"2023-11-24T06:13:41.924483+0000","last_fullsized":"2023-11-24T06:13:41.924483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950703+0000","last_change":"2023-11-24T06:13:41.944099+0000","last_active":"2023-11-24T06:13:41.950703+0000","last_peered":"2023-11-24T06:13:41.950703+0000","last_clean":"2023-11-24T06:13:41.950703+0000","last_became_active":"2023-11-24T06:13:41.943810+0000","last_became_peered":"2023-11-24T06:13:41.943810+0000","last_unstale":"2023-11-24T06:13:41.950703+0000","last_undegraded":"2023-11-24T06:13:41.950703+0000","last_fullsized":"2023-11-24T06:13:41.950703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931682+0000","last_change":"2023-11-24T06:13:40.931296+0000","last_active":"2023-11-24T06:13:41.931682+0000","last_peered":"2023-11-24T06:13:41.931682+0000","last_clean":"2023-11-24T06:13:41.931682+0000","last_became_active":"2023-11-24T06:13:40.931008+0000","last_became_peered":"2023-11-24T06:13:40.931008+0000","last_unstale":"2023-11-24T06:13:41.931682+0000","last_undegraded":"2023-11-24T06:13:41.931682+0000","last_fullsized":"2023-11-24T06:13:41.931682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.949677+0000","last_change":"2023-11-24T06:13:41.941033+0000","last_active":"2023-11-24T06:13:41.949677+0000","last_peered":"2023-11-24T06:13:41.949677+0000","last_clean":"2023-11-24T06:13:41.949677+0000","last_became_active":"2023-11-24T06:13:41.940774+0000","last_became_peered":"2023-11-24T06:13:41.940774+0000","last_unstale":"2023-11-24T06:13:41.949677+0000","last_undegraded":"2023-11-24T06:13:41.949677+0000","last_fullsized":"2023-11-24T06:13:41.949677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951607+0000","last_change":"2023-11-24T06:13:41.940234+0000","last_active":"2023-11-24T06:13:41.951607+0000","last_peered":"2023-11-24T06:13:41.951607+0000","last_clean":"2023-11-24T06:13:41.951607+0000","last_became_active":"2023-11-24T06:13:41.939983+0000","last_became_peered":"2023-11-24T06:13:41.939983+0000","last_unstale":"2023-11-24T06:13:41.951607+0000","last_undegraded":"2023-11-24T06:13:41.951607+0000","last_fullsized":"2023-11-24T06:13:41.951607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.937048+0000","last_change":"2023-11-24T06:13:40.925168+0000","last_active":"2023-11-24T06:13:41.937048+0000","last_peered":"2023-11-24T06:13:41.937048+0000","last_clean":"2023-11-24T06:13:41.937048+0000","last_became_active":"2023-11-24T06:13:40.924883+0000","last_became_peered":"2023-11-24T06:13:40.924883+0000","last_unstale":"2023-11-24T06:13:41.937048+0000","last_undegraded":"2023-11-24T06:13:41.937048+0000","last_fullsized":"2023-11-24T06:13:41.937048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956820+0000","last_change":"2023-11-24T06:13:41.952514+0000","last_active":"2023-11-24T06:13:41.956820+0000","last_peered":"2023-11-24T06:13:41.956820+0000","last_clean":"2023-11-24T06:13:41.956820+0000","last_became_active":"2023-11-24T06:13:41.952318+0000","last_became_peered":"2023-11-24T06:13:41.952318+0000","last_unstale":"2023-11-24T06:13:41.956820+0000","last_undegraded":"2023-11-24T06:13:41.956820+0000","last_fullsized":"2023-11-24T06:13:41.956820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.929339+0000","last_change":"2023-11-24T06:13:40.928925+0000","last_active":"2023-11-24T06:13:41.929339+0000","last_peered":"2023-11-24T06:13:41.929339+0000","last_clean":"2023-11-24T06:13:41.929339+0000","last_became_active":"2023-11-24T06:13:40.928516+0000","last_became_peered":"2023-11-24T06:13:40.928516+0000","last_unstale":"2023-11-24T06:13:41.929339+0000","last_undegraded":"2023-11-24T06:13:41.929339+0000","last_fullsized":"2023-11-24T06:13:41.929339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-24T06:13:40.930048+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:13:40.930048+0000","last_peered":"2023-11-24T06:13:40.930048+0000","last_clean":"2023-11-24T06:13:40.930048+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:13:40.930048+0000","last_undegraded":"2023-11-24T06:13:40.930048+0000","last_fullsized":"2023-11-24T06:13:40.930048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946763+0000","last_change":"2023-11-24T06:13:41.941594+0000","last_active":"2023-11-24T06:13:41.946763+0000","last_peered":"2023-11-24T06:13:41.946763+0000","last_clean":"2023-11-24T06:13:41.946763+0000","last_became_active":"2023-11-24T06:13:41.940870+0000","last_became_peered":"2023-11-24T06:13:41.940870+0000","last_unstale":"2023-11-24T06:13:41.946763+0000","last_undegraded":"2023-11-24T06:13:41.946763+0000","last_fullsized":"2023-11-24T06:13:41.946763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:30.383021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931078+0000","last_change":"2023-11-24T06:13:40.936258+0000","last_active":"2023-11-24T06:13:41.931078+0000","last_peered":"2023-11-24T06:13:41.931078+0000","last_clean":"2023-11-24T06:13:41.931078+0000","last_became_active":"2023-11-24T06:13:40.936027+0000","last_became_peered":"2023-11-24T06:13:40.936027+0000","last_unstale":"2023-11-24T06:13:41.931078+0000","last_undegraded":"2023-11-24T06:13:41.931078+0000","last_fullsized":"2023-11-24T06:13:41.931078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931500+0000","last_change":"2023-11-24T06:13:40.935763+0000","last_active":"2023-11-24T06:13:41.931500+0000","last_peered":"2023-11-24T06:13:41.931500+0000","last_clean":"2023-11-24T06:13:41.931500+0000","last_became_active":"2023-11-24T06:13:40.935501+0000","last_became_peered":"2023-11-24T06:13:40.935501+0000","last_unstale":"2023-11-24T06:13:41.931500+0000","last_undegraded":"2023-11-24T06:13:41.931500+0000","last_fullsized":"2023-11-24T06:13:41.931500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951556+0000","last_change":"2023-11-24T06:13:41.939692+0000","last_active":"2023-11-24T06:13:41.951556+0000","last_peered":"2023-11-24T06:13:41.951556+0000","last_clean":"2023-11-24T06:13:41.951556+0000","last_became_active":"2023-11-24T06:13:41.939436+0000","last_became_peered":"2023-11-24T06:13:41.939436+0000","last_unstale":"2023-11-24T06:13:41.951556+0000","last_undegraded":"2023-11-24T06:13:41.951556+0000","last_fullsized":"2023-11-24T06:13:41.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923883+0000","last_change":"2023-11-24T06:13:40.929038+0000","last_active":"2023-11-24T06:13:41.923883+0000","last_peered":"2023-11-24T06:13:41.923883+0000","last_clean":"2023-11-24T06:13:41.923883+0000","last_became_active":"2023-11-24T06:13:40.928695+0000","last_became_peered":"2023-11-24T06:13:40.928695+0000","last_unstale":"2023-11-24T06:13:41.923883+0000","last_undegraded":"2023-11-24T06:13:41.923883+0000","last_fullsized":"2023-11-24T06:13:41.923883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956758+0000","last_change":"2023-11-24T06:13:41.951155+0000","last_active":"2023-11-24T06:13:41.956758+0000","last_peered":"2023-11-24T06:13:41.956758+0000","last_clean":"2023-11-24T06:13:41.956758+0000","last_became_active":"2023-11-24T06:13:41.950865+0000","last_became_peered":"2023-11-24T06:13:41.950865+0000","last_unstale":"2023-11-24T06:13:41.956758+0000","last_undegraded":"2023-11-24T06:13:41.956758+0000","last_fullsized":"2023-11-24T06:13:41.956758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954248+0000","last_change":"2023-11-24T06:13:40.928532+0000","last_active":"2023-11-24T06:13:41.954248+0000","last_peered":"2023-11-24T06:13:41.954248+0000","last_clean":"2023-11-24T06:13:41.954248+0000","last_became_active":"2023-11-24T06:13:40.928254+0000","last_became_peered":"2023-11-24T06:13:40.928254+0000","last_unstale":"2023-11-24T06:13:41.954248+0000","last_undegraded":"2023-11-24T06:13:41.954248+0000","last_fullsized":"2023-11-24T06:13:41.954248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944645+0000","last_change":"2023-11-24T06:13:41.938598+0000","last_active":"2023-11-24T06:13:41.944645+0000","last_peered":"2023-11-24T06:13:41.944645+0000","last_clean":"2023-11-24T06:13:41.944645+0000","last_became_active":"2023-11-24T06:13:41.938250+0000","last_became_peered":"2023-11-24T06:13:41.938250+0000","last_unstale":"2023-11-24T06:13:41.944645+0000","last_undegraded":"2023-11-24T06:13:41.944645+0000","last_fullsized":"2023-11-24T06:13:41.944645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930844+0000","last_change":"2023-11-24T06:13:40.935938+0000","last_active":"2023-11-24T06:13:41.930844+0000","last_peered":"2023-11-24T06:13:41.930844+0000","last_clean":"2023-11-24T06:13:41.930844+0000","last_became_active":"2023-11-24T06:13:40.935654+0000","last_became_peered":"2023-11-24T06:13:40.935654+0000","last_unstale":"2023-11-24T06:13:41.930844+0000","last_undegraded":"2023-11-24T06:13:41.930844+0000","last_fullsized":"2023-11-24T06:13:41.930844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954874+0000","last_change":"2023-11-24T06:13:41.943430+0000","last_active":"2023-11-24T06:13:41.954874+0000","last_peered":"2023-11-24T06:13:41.954874+0000","last_clean":"2023-11-24T06:13:41.954874+0000","last_became_active":"2023-11-24T06:13:41.940218+0000","last_became_peered":"2023-11-24T06:13:41.940218+0000","last_unstale":"2023-11-24T06:13:41.954874+0000","last_undegraded":"2023-11-24T06:13:41.954874+0000","last_fullsized":"2023-11-24T06:13:41.954874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923735+0000","last_change":"2023-11-24T06:13:40.934827+0000","last_active":"2023-11-24T06:13:41.923735+0000","last_peered":"2023-11-24T06:13:41.923735+0000","last_clean":"2023-11-24T06:13:41.923735+0000","last_became_active":"2023-11-24T06:13:40.934569+0000","last_became_peered":"2023-11-24T06:13:40.934569+0000","last_unstale":"2023-11-24T06:13:41.923735+0000","last_undegraded":"2023-11-24T06:13:41.923735+0000","last_fullsized":"2023-11-24T06:13:41.923735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956875+0000","last_change":"2023-11-24T06:13:41.952768+0000","last_active":"2023-11-24T06:13:41.956875+0000","last_peered":"2023-11-24T06:13:41.956875+0000","last_clean":"2023-11-24T06:13:41.956875+0000","last_became_active":"2023-11-24T06:13:41.952505+0000","last_became_peered":"2023-11-24T06:13:41.952505+0000","last_unstale":"2023-11-24T06:13:41.956875+0000","last_undegraded":"2023-11-24T06:13:41.956875+0000","last_fullsized":"2023-11-24T06:13:41.956875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923781+0000","last_change":"2023-11-24T06:13:40.930150+0000","last_active":"2023-11-24T06:13:41.923781+0000","last_peered":"2023-11-24T06:13:41.923781+0000","last_clean":"2023-11-24T06:13:41.923781+0000","last_became_active":"2023-11-24T06:13:40.929863+0000","last_became_peered":"2023-11-24T06:13:40.929863+0000","last_unstale":"2023-11-24T06:13:41.923781+0000","last_undegraded":"2023-11-24T06:13:41.923781+0000","last_fullsized":"2023-11-24T06:13:41.923781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956737+0000","last_change":"2023-11-24T06:13:41.951171+0000","last_active":"2023-11-24T06:13:41.956737+0000","last_peered":"2023-11-24T06:13:41.956737+0000","last_clean":"2023-11-24T06:13:41.956737+0000","last_became_active":"2023-11-24T06:13:41.950836+0000","last_became_peered":"2023-11-24T06:13:41.950836+0000","last_unstale":"2023-11-24T06:13:41.956737+0000","last_undegraded":"2023-11-24T06:13:41.956737+0000","last_fullsized":"2023-11-24T06:13:41.956737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955471+0000","last_change":"2023-11-24T06:13:40.934976+0000","last_active":"2023-11-24T06:13:41.955471+0000","last_peered":"2023-11-24T06:13:41.955471+0000","last_clean":"2023-11-24T06:13:41.955471+0000","last_became_active":"2023-11-24T06:13:40.934665+0000","last_became_peered":"2023-11-24T06:13:40.934665+0000","last_unstale":"2023-11-24T06:13:41.955471+0000","last_undegraded":"2023-11-24T06:13:41.955471+0000","last_fullsized":"2023-11-24T06:13:41.955471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946304+0000","last_change":"2023-11-24T06:13:41.938322+0000","last_active":"2023-11-24T06:13:41.946304+0000","last_peered":"2023-11-24T06:13:41.946304+0000","last_clean":"2023-11-24T06:13:41.946304+0000","last_became_active":"2023-11-24T06:13:41.938032+0000","last_became_peered":"2023-11-24T06:13:41.938032+0000","last_unstale":"2023-11-24T06:13:41.946304+0000","last_undegraded":"2023-11-24T06:13:41.946304+0000","last_fullsized":"2023-11-24T06:13:41.946304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.936662+0000","last_change":"2023-11-24T06:13:40.931158+0000","last_active":"2023-11-24T06:13:41.936662+0000","last_peered":"2023-11-24T06:13:41.936662+0000","last_clean":"2023-11-24T06:13:41.936662+0000","last_became_active":"2023-11-24T06:13:40.930820+0000","last_became_peered":"2023-11-24T06:13:40.930820+0000","last_unstale":"2023-11-24T06:13:41.936662+0000","last_undegraded":"2023-11-24T06:13:41.936662+0000","last_fullsized":"2023-11-24T06:13:41.936662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952079+0000","last_change":"2023-11-24T06:13:41.949647+0000","last_active":"2023-11-24T06:13:41.952079+0000","last_peered":"2023-11-24T06:13:41.952079+0000","last_clean":"2023-11-24T06:13:41.952079+0000","last_became_active":"2023-11-24T06:13:41.949346+0000","last_became_peered":"2023-11-24T06:13:41.949346+0000","last_unstale":"2023-11-24T06:13:41.952079+0000","last_undegraded":"2023-11-24T06:13:41.952079+0000","last_fullsized":"2023-11-24T06:13:41.952079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955430+0000","last_change":"2023-11-24T06:13:40.932491+0000","last_active":"2023-11-24T06:13:41.955430+0000","last_peered":"2023-11-24T06:13:41.955430+0000","last_clean":"2023-11-24T06:13:41.955430+0000","last_became_active":"2023-11-24T06:13:40.932251+0000","last_became_peered":"2023-11-24T06:13:40.932251+0000","last_unstale":"2023-11-24T06:13:41.955430+0000","last_undegraded":"2023-11-24T06:13:41.955430+0000","last_fullsized":"2023-11-24T06:13:41.955430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950919+0000","last_change":"2023-11-24T06:13:41.947115+0000","last_active":"2023-11-24T06:13:41.950919+0000","last_peered":"2023-11-24T06:13:41.950919+0000","last_clean":"2023-11-24T06:13:41.950919+0000","last_became_active":"2023-11-24T06:13:41.944203+0000","last_became_peered":"2023-11-24T06:13:41.944203+0000","last_unstale":"2023-11-24T06:13:41.950919+0000","last_undegraded":"2023-11-24T06:13:41.950919+0000","last_fullsized":"2023-11-24T06:13:41.950919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951358+0000","last_change":"2023-11-24T06:13:40.926973+0000","last_active":"2023-11-24T06:13:41.951358+0000","last_peered":"2023-11-24T06:13:41.951358+0000","last_clean":"2023-11-24T06:13:41.951358+0000","last_became_active":"2023-11-24T06:13:40.926745+0000","last_became_peered":"2023-11-24T06:13:40.926745+0000","last_unstale":"2023-11-24T06:13:41.951358+0000","last_undegraded":"2023-11-24T06:13:41.951358+0000","last_fullsized":"2023-11-24T06:13:41.951358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:57.388385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951887+0000","last_change":"2023-11-24T06:13:41.946697+0000","last_active":"2023-11-24T06:13:41.951887+0000","last_peered":"2023-11-24T06:13:41.951887+0000","last_clean":"2023-11-24T06:13:41.951887+0000","last_became_active":"2023-11-24T06:13:41.946341+0000","last_became_peered":"2023-11-24T06:13:41.946341+0000","last_unstale":"2023-11-24T06:13:41.951887+0000","last_undegraded":"2023-11-24T06:13:41.951887+0000","last_fullsized":"2023-11-24T06:13:41.951887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946285+0000","last_change":"2023-11-24T06:13:41.936743+0000","last_active":"2023-11-24T06:13:41.946285+0000","last_peered":"2023-11-24T06:13:41.946285+0000","last_clean":"2023-11-24T06:13:41.946285+0000","last_became_active":"2023-11-24T06:13:41.936048+0000","last_became_peered":"2023-11-24T06:13:41.936048+0000","last_unstale":"2023-11-24T06:13:41.946285+0000","last_undegraded":"2023-11-24T06:13:41.946285+0000","last_fullsized":"2023-11-24T06:13:41.946285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953807+0000","last_change":"2023-11-24T06:13:41.951555+0000","last_active":"2023-11-24T06:13:41.953807+0000","last_peered":"2023-11-24T06:13:41.953807+0000","last_clean":"2023-11-24T06:13:41.953807+0000","last_became_active":"2023-11-24T06:13:41.951290+0000","last_became_peered":"2023-11-24T06:13:41.951290+0000","last_unstale":"2023-11-24T06:13:41.953807+0000","last_undegraded":"2023-11-24T06:13:41.953807+0000","last_fullsized":"2023-11-24T06:13:41.953807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951400+0000","last_change":"2023-11-24T06:13:41.945563+0000","last_active":"2023-11-24T06:13:41.951400+0000","last_peered":"2023-11-24T06:13:41.951400+0000","last_clean":"2023-11-24T06:13:41.951400+0000","last_became_active":"2023-11-24T06:13:41.943916+0000","last_became_peered":"2023-11-24T06:13:41.943916+0000","last_unstale":"2023-11-24T06:13:41.951400+0000","last_undegraded":"2023-11-24T06:13:41.951400+0000","last_fullsized":"2023-11-24T06:13:41.951400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946801+0000","last_change":"2023-11-24T06:13:41.943045+0000","last_active":"2023-11-24T06:13:41.946801+0000","last_peered":"2023-11-24T06:13:41.946801+0000","last_clean":"2023-11-24T06:13:41.946801+0000","last_became_active":"2023-11-24T06:13:41.942182+0000","last_became_peered":"2023-11-24T06:13:41.942182+0000","last_unstale":"2023-11-24T06:13:41.946801+0000","last_undegraded":"2023-11-24T06:13:41.946801+0000","last_fullsized":"2023-11-24T06:13:41.946801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953482+0000","last_change":"2023-11-24T06:13:41.950138+0000","last_active":"2023-11-24T06:13:41.953482+0000","last_peered":"2023-11-24T06:13:41.953482+0000","last_clean":"2023-11-24T06:13:41.953482+0000","last_became_active":"2023-11-24T06:13:41.949872+0000","last_became_peered":"2023-11-24T06:13:41.949872+0000","last_unstale":"2023-11-24T06:13:41.953482+0000","last_undegraded":"2023-11-24T06:13:41.953482+0000","last_fullsized":"2023-11-24T06:13:41.953482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954054+0000","last_change":"2023-11-24T06:13:41.942213+0000","last_active":"2023-11-24T06:13:41.954054+0000","last_peered":"2023-11-24T06:13:41.954054+0000","last_clean":"2023-11-24T06:13:41.954054+0000","last_became_active":"2023-11-24T06:13:41.941946+0000","last_became_peered":"2023-11-24T06:13:41.941946+0000","last_unstale":"2023-11-24T06:13:41.954054+0000","last_undegraded":"2023-11-24T06:13:41.954054+0000","last_fullsized":"2023-11-24T06:13:41.954054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.959502+0000","last_change":"2023-11-24T06:13:41.954479+0000","last_active":"2023-11-24T06:13:41.959502+0000","last_peered":"2023-11-24T06:13:41.959502+0000","last_clean":"2023-11-24T06:13:41.959502+0000","last_became_active":"2023-11-24T06:13:41.954180+0000","last_became_peered":"2023-11-24T06:13:41.954180+0000","last_unstale":"2023-11-24T06:13:41.959502+0000","last_undegraded":"2023-11-24T06:13:41.959502+0000","last_fullsized":"2023-11-24T06:13:41.959502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956623+0000","last_change":"2023-11-24T06:13:41.950255+0000","last_active":"2023-11-24T06:13:41.956623+0000","last_peered":"2023-11-24T06:13:41.956623+0000","last_clean":"2023-11-24T06:13:41.956623+0000","last_became_active":"2023-11-24T06:13:41.949950+0000","last_became_peered":"2023-11-24T06:13:41.949950+0000","last_unstale":"2023-11-24T06:13:41.956623+0000","last_undegraded":"2023-11-24T06:13:41.956623+0000","last_fullsized":"2023-11-24T06:13:41.956623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951105+0000","last_change":"2023-11-24T06:13:41.945908+0000","last_active":"2023-11-24T06:13:41.951105+0000","last_peered":"2023-11-24T06:13:41.951105+0000","last_clean":"2023-11-24T06:13:41.951105+0000","last_became_active":"2023-11-24T06:13:41.945619+0000","last_became_peered":"2023-11-24T06:13:41.945619+0000","last_unstale":"2023-11-24T06:13:41.951105+0000","last_undegraded":"2023-11-24T06:13:41.951105+0000","last_fullsized":"2023-11-24T06:13:41.951105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956880+0000","last_change":"2023-11-24T06:13:41.955593+0000","last_active":"2023-11-24T06:13:41.956880+0000","last_peered":"2023-11-24T06:13:41.956880+0000","last_clean":"2023-11-24T06:13:41.956880+0000","last_became_active":"2023-11-24T06:13:41.955287+0000","last_became_peered":"2023-11-24T06:13:41.955287+0000","last_unstale":"2023-11-24T06:13:41.956880+0000","last_undegraded":"2023-11-24T06:13:41.956880+0000","last_fullsized":"2023-11-24T06:13:41.956880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951417+0000","last_change":"2023-11-24T06:13:41.948053+0000","last_active":"2023-11-24T06:13:41.951417+0000","last_peered":"2023-11-24T06:13:41.951417+0000","last_clean":"2023-11-24T06:13:41.951417+0000","last_became_active":"2023-11-24T06:13:41.947768+0000","last_became_peered":"2023-11-24T06:13:41.947768+0000","last_unstale":"2023-11-24T06:13:41.951417+0000","last_undegraded":"2023-11-24T06:13:41.951417+0000","last_fullsized":"2023-11-24T06:13:41.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953209+0000","last_change":"2023-11-24T06:13:41.948146+0000","last_active":"2023-11-24T06:13:41.953209+0000","last_peered":"2023-11-24T06:13:41.953209+0000","last_clean":"2023-11-24T06:13:41.953209+0000","last_became_active":"2023-11-24T06:13:41.947853+0000","last_became_peered":"2023-11-24T06:13:41.947853+0000","last_unstale":"2023-11-24T06:13:41.953209+0000","last_undegraded":"2023-11-24T06:13:41.953209+0000","last_fullsized":"2023-11-24T06:13:41.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946624+0000","last_change":"2023-11-24T06:13:41.939852+0000","last_active":"2023-11-24T06:13:41.946624+0000","last_peered":"2023-11-24T06:13:41.946624+0000","last_clean":"2023-11-24T06:13:41.946624+0000","last_became_active":"2023-11-24T06:13:41.939587+0000","last_became_peered":"2023-11-24T06:13:41.939587+0000","last_unstale":"2023-11-24T06:13:41.946624+0000","last_undegraded":"2023-11-24T06:13:41.946624+0000","last_fullsized":"2023-11-24T06:13:41.946624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":648203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:46.025 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:46.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.177+0000 7fb28df36700 1 Processor -- start 2023-11-24T06:13:46.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.177+0000 7fb28df36700 1 -- start start 2023-11-24T06:13:46.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb28df36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb2880d05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb28df36700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880d0150 con 0x7fb2880ce4d0 2023-11-24T06:13:46.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb28df36700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2880cee50 con 0x7fb28815e080 2023-11-24T06:13:46.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb28df36700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb28815e460 con 0x7fb2880d22f0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb286ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb2880ce4d0 0x7fb2880d1be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38048/0 (socket says 172.21.15.106:38048) 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb286ffd700 1 -- 172.21.15.106:0/3256534419 learned_addr learned my addr 172.21.15.106:0/3256534419 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb287fff700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb2880d05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 615100316 0 0) 0x7fb2880d0150 con 0x7fb2880ce4d0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.178+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2700035b0 con 0x7fb2880ce4d0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2019870177 0 0) 0x7fb2700035b0 con 0x7fb2880ce4d0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 msgr2=0x7fb2880d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb2880d05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 >> v1:172.21.15.176:6789/0 conn(0x7fb28815e080 legacy=0x7fb2880cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880cf130 con 0x7fb2880ce4d0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb278001670 con 0x7fb2880ce4d0 2023-11-24T06:13:46.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 >> v1:172.21.15.106:6789/0 conn(0x7fb2880ce4d0 legacy=0x7fb2880d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb270003a30 0x7fb270003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2700048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb270005110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb28815e460 con 0x7fb2700043e0 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27000ba40 con 0x7fb270003a30 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27000bc00 con 0x7fb2880d22f0 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2700048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2877fe700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb270003a30 0x7fb270003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb287fff700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb270005110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 -- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 msgr2=0x7fb270005110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2880d22f0 0x7fb270005110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 -- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb270003a30 msgr2=0x7fb270003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb270003a30 0x7fb270003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 -- 172.21.15.106:0/3256534419 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2700035b0 con 0x7fb2700043e0 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb286ffd700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2700048b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c240 tx=0x7fb270005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8812d468f8257879 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27800cd80 con 0x7fb2700043e0 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb278005960 con 0x7fb2700043e0 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.179+0000 7fb2867fc700 1 -- 172.21.15.106:0/3256534419 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb278005d10 con 0x7fb2700043e0 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 -- 172.21.15.106:0/3256534419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 msgr2=0x7fb2700048b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 --2- 172.21.15.106:0/3256534419 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2700048b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb27800c240 tx=0x7fb270005880 comp rx=0 tx=0).stop 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb287fff700 1 -- 172.21.15.106:0/3256534419 reap_dead start 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 -- 172.21.15.106:0/3256534419 shutdown_connections 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 -- 172.21.15.106:0/3256534419 >> 172.21.15.106:0/3256534419 conn(0x7fb288073130 msgr2=0x7fb28809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 -- 172.21.15.106:0/3256534419 shutdown_connections 2023-11-24T06:13:46.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.180+0000 7fb28df36700 1 -- 172.21.15.106:0/3256534419 wait complete. 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.181+0000 7fb28df36700 1 Processor -- start 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.181+0000 7fb28df36700 1 -- start start 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb288156f00 0x7fb2880b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2881503f0 0x7fb2880c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880b7900 con 0x7fb2700043e0 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880cbae0 con 0x7fb288156f00 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb28df36700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2880cac30 con 0x7fb2881503f0 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57796/0 (socket says 172.21.15.106:57796) 2023-11-24T06:13:46.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 -- 172.21.15.106:0/4202120839 learned_addr learned my addr 172.21.15.106:0/4202120839 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb287fff700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2881503f0 0x7fb2880c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 -- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2881503f0 msgr2=0x7fb2880c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb286ffd700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb288156f00 0x7fb2880b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2881503f0 0x7fb2880c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 -- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb288156f00 msgr2=0x7fb2880b73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb288156f00 0x7fb2880b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.182+0000 7fb2877fe700 1 -- 172.21.15.106:0/4202120839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2880caed0 con 0x7fb2700043e0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb2877fe700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00f770 tx=0x7fb27c00fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0052e0 con 0x7fb2700043e0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27c005440 con 0x7fb2700043e0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27c0038c0 con 0x7fb2700043e0 2023-11-24T06:13:46.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2880cb1b0 con 0x7fb2700043e0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.183+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2880cb770 con 0x7fb2700043e0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.184+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2880cbdc0 con 0x7fb2700043e0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.184+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb27c003a20 con 0x7fb2700043e0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.184+0000 7fb26ffff700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 0x7fb27406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.185+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb27c0893c0 con 0x7fb2700043e0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.185+0000 7fb286ffd700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 0x7fb27406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.185+0000 7fb286ffd700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 0x7fb27406d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2880c4d00 tx=0x7fb27800a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.189+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb27c054500 con 0x7fb2700043e0 2023-11-24T06:13:46.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.372+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb2880cbc20 con 0x7fb27406aed0 2023-11-24T06:13:46.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.379+0000 7fb26ffff700 1 -- 172.21.15.106:0/4202120839 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264633 (secure 0 0 0) 0x7fb278022070 con 0x7fb27406aed0 2023-11-24T06:13:46.384 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 msgr2=0x7fb27406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 0x7fb27406d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb2880c4d00 tx=0x7fb27800a000 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 msgr2=0x7fb2880cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00f770 tx=0x7fb27c00fb30 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 shutdown_connections 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb27406aed0 0x7fb27406d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb2881503f0 0x7fb2880c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2700043e0 0x7fb2880cbf70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 --2- 172.21.15.106:0/4202120839 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb288156f00 0x7fb2880b73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 >> 172.21.15.106:0/4202120839 conn(0x7fb288073130 msgr2=0x7fb288160f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 shutdown_connections 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.382+0000 7fb28df36700 1 -- 172.21.15.106:0/4202120839 wait complete. 2023-11-24T06:13:46.387 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:13:46.396 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-11-24T06:13:45.687923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218808,"kb_used_data":2632,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755912,"statfs":{"total":773094113280,"available":772870053888,"internally_reserved":0,"allocated":2695168,"data_stored":1666061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.778734"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951924+0000","last_change":"2023-11-24T06:13:41.947526+0000","last_active":"2023-11-24T06:13:41.951924+0000","last_peered":"2023-11-24T06:13:41.951924+0000","last_clean":"2023-11-24T06:13:41.951924+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:41.951924+0000","last_undegraded":"2023-11-24T06:13:41.951924+0000","last_fullsized":"2023-11-24T06:13:41.951924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.937676+0000","last_change":"2023-11-24T06:13:41.934747+0000","last_active":"2023-11-24T06:13:41.937676+0000","last_peered":"2023-11-24T06:13:41.937676+0000","last_clean":"2023-11-24T06:13:41.937676+0000","last_became_active":"2023-11-24T06:13:41.933914+0000","last_became_peered":"2023-11-24T06:13:41.933914+0000","last_unstale":"2023-11-24T06:13:41.937676+0000","last_undegraded":"2023-11-24T06:13:41.937676+0000","last_fullsized":"2023-11-24T06:13:41.937676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944862+0000","last_change":"2023-11-24T06:13:41.939402+0000","last_active":"2023-11-24T06:13:41.944862+0000","last_peered":"2023-11-24T06:13:41.944862+0000","last_clean":"2023-11-24T06:13:41.944862+0000","last_became_active":"2023-11-24T06:13:41.939116+0000","last_became_peered":"2023-11-24T06:13:41.939116+0000","last_unstale":"2023-11-24T06:13:41.944862+0000","last_undegraded":"2023-11-24T06:13:41.944862+0000","last_fullsized":"2023-11-24T06:13:41.944862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950899+0000","last_change":"2023-11-24T06:13:41.946934+0000","last_active":"2023-11-24T06:13:41.950899+0000","last_peered":"2023-11-24T06:13:41.950899+0000","last_clean":"2023-11-24T06:13:41.950899+0000","last_became_active":"2023-11-24T06:13:41.943823+0000","last_became_peered":"2023-11-24T06:13:41.943823+0000","last_unstale":"2023-11-24T06:13:41.950899+0000","last_undegraded":"2023-11-24T06:13:41.950899+0000","last_fullsized":"2023-11-24T06:13:41.950899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951954+0000","last_change":"2023-11-24T06:13:41.947399+0000","last_active":"2023-11-24T06:13:41.951954+0000","last_peered":"2023-11-24T06:13:41.951954+0000","last_clean":"2023-11-24T06:13:41.951954+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:41.951954+0000","last_undegraded":"2023-11-24T06:13:41.951954+0000","last_fullsized":"2023-11-24T06:13:41.951954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951366+0000","last_change":"2023-11-24T06:13:41.937172+0000","last_active":"2023-11-24T06:13:41.951366+0000","last_peered":"2023-11-24T06:13:41.951366+0000","last_clean":"2023-11-24T06:13:41.951366+0000","last_became_active":"2023-11-24T06:13:41.935849+0000","last_became_peered":"2023-11-24T06:13:41.935849+0000","last_unstale":"2023-11-24T06:13:41.951366+0000","last_undegraded":"2023-11-24T06:13:41.951366+0000","last_fullsized":"2023-11-24T06:13:41.951366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951114+0000","last_change":"2023-11-24T06:13:41.945826+0000","last_active":"2023-11-24T06:13:41.951114+0000","last_peered":"2023-11-24T06:13:41.951114+0000","last_clean":"2023-11-24T06:13:41.951114+0000","last_became_active":"2023-11-24T06:13:41.945194+0000","last_became_peered":"2023-11-24T06:13:41.945194+0000","last_unstale":"2023-11-24T06:13:41.951114+0000","last_undegraded":"2023-11-24T06:13:41.951114+0000","last_fullsized":"2023-11-24T06:13:41.951114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956854+0000","last_change":"2023-11-24T06:13:41.952679+0000","last_active":"2023-11-24T06:13:41.956854+0000","last_peered":"2023-11-24T06:13:41.956854+0000","last_clean":"2023-11-24T06:13:41.956854+0000","last_became_active":"2023-11-24T06:13:41.952160+0000","last_became_peered":"2023-11-24T06:13:41.952160+0000","last_unstale":"2023-11-24T06:13:41.956854+0000","last_undegraded":"2023-11-24T06:13:41.956854+0000","last_fullsized":"2023-11-24T06:13:41.956854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953654+0000","last_change":"2023-11-24T06:13:41.949930+0000","last_active":"2023-11-24T06:13:41.953654+0000","last_peered":"2023-11-24T06:13:41.953654+0000","last_clean":"2023-11-24T06:13:41.953654+0000","last_became_active":"2023-11-24T06:13:41.949654+0000","last_became_peered":"2023-11-24T06:13:41.949654+0000","last_unstale":"2023-11-24T06:13:41.953654+0000","last_undegraded":"2023-11-24T06:13:41.953654+0000","last_fullsized":"2023-11-24T06:13:41.953654+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.947905+0000","last_change":"2023-11-24T06:13:41.944967+0000","last_active":"2023-11-24T06:13:41.947905+0000","last_peered":"2023-11-24T06:13:41.947905+0000","last_clean":"2023-11-24T06:13:41.947905+0000","last_became_active":"2023-11-24T06:13:41.944686+0000","last_became_peered":"2023-11-24T06:13:41.944686+0000","last_unstale":"2023-11-24T06:13:41.947905+0000","last_undegraded":"2023-11-24T06:13:41.947905+0000","last_fullsized":"2023-11-24T06:13:41.947905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946272+0000","last_change":"2023-11-24T06:13:41.938879+0000","last_active":"2023-11-24T06:13:41.946272+0000","last_peered":"2023-11-24T06:13:41.946272+0000","last_clean":"2023-11-24T06:13:41.946272+0000","last_became_active":"2023-11-24T06:13:41.938609+0000","last_became_peered":"2023-11-24T06:13:41.938609+0000","last_unstale":"2023-11-24T06:13:41.946272+0000","last_undegraded":"2023-11-24T06:13:41.946272+0000","last_fullsized":"2023-11-24T06:13:41.946272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.938425+0000","last_change":"2023-11-24T06:13:41.934572+0000","last_active":"2023-11-24T06:13:41.938425+0000","last_peered":"2023-11-24T06:13:41.938425+0000","last_clean":"2023-11-24T06:13:41.938425+0000","last_became_active":"2023-11-24T06:13:41.934367+0000","last_became_peered":"2023-11-24T06:13:41.934367+0000","last_unstale":"2023-11-24T06:13:41.938425+0000","last_undegraded":"2023-11-24T06:13:41.938425+0000","last_fullsized":"2023-11-24T06:13:41.938425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:58:21.038778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956689+0000","last_change":"2023-11-24T06:13:41.950738+0000","last_active":"2023-11-24T06:13:41.956689+0000","last_peered":"2023-11-24T06:13:41.956689+0000","last_clean":"2023-11-24T06:13:41.956689+0000","last_became_active":"2023-11-24T06:13:41.950177+0000","last_became_peered":"2023-11-24T06:13:41.950177+0000","last_unstale":"2023-11-24T06:13:41.956689+0000","last_undegraded":"2023-11-24T06:13:41.956689+0000","last_fullsized":"2023-11-24T06:13:41.956689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.942517+0000","last_change":"2023-11-24T06:13:41.934953+0000","last_active":"2023-11-24T06:13:41.942517+0000","last_peered":"2023-11-24T06:13:41.942517+0000","last_clean":"2023-11-24T06:13:41.942517+0000","last_became_active":"2023-11-24T06:13:41.934659+0000","last_became_peered":"2023-11-24T06:13:41.934659+0000","last_unstale":"2023-11-24T06:13:41.942517+0000","last_undegraded":"2023-11-24T06:13:41.942517+0000","last_fullsized":"2023-11-24T06:13:41.942517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.933892+0000","last_change":"2023-11-24T06:13:41.928498+0000","last_active":"2023-11-24T06:13:41.933892+0000","last_peered":"2023-11-24T06:13:41.933892+0000","last_clean":"2023-11-24T06:13:41.933892+0000","last_became_active":"2023-11-24T06:13:41.928189+0000","last_became_peered":"2023-11-24T06:13:41.928189+0000","last_unstale":"2023-11-24T06:13:41.933892+0000","last_undegraded":"2023-11-24T06:13:41.933892+0000","last_fullsized":"2023-11-24T06:13:41.933892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951071+0000","last_change":"2023-11-24T06:13:41.940907+0000","last_active":"2023-11-24T06:13:41.951071+0000","last_peered":"2023-11-24T06:13:41.951071+0000","last_clean":"2023-11-24T06:13:41.951071+0000","last_became_active":"2023-11-24T06:13:41.937993+0000","last_became_peered":"2023-11-24T06:13:41.937993+0000","last_unstale":"2023-11-24T06:13:41.951071+0000","last_undegraded":"2023-11-24T06:13:41.951071+0000","last_fullsized":"2023-11-24T06:13:41.951071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951010+0000","last_change":"2023-11-24T06:13:41.947880+0000","last_active":"2023-11-24T06:13:41.951010+0000","last_peered":"2023-11-24T06:13:41.951010+0000","last_clean":"2023-11-24T06:13:41.951010+0000","last_became_active":"2023-11-24T06:13:41.947592+0000","last_became_peered":"2023-11-24T06:13:41.947592+0000","last_unstale":"2023-11-24T06:13:41.951010+0000","last_undegraded":"2023-11-24T06:13:41.951010+0000","last_fullsized":"2023-11-24T06:13:41.951010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.949058+0000","last_change":"2023-11-24T06:13:41.947575+0000","last_active":"2023-11-24T06:13:41.949058+0000","last_peered":"2023-11-24T06:13:41.949058+0000","last_clean":"2023-11-24T06:13:41.949058+0000","last_became_active":"2023-11-24T06:13:41.947285+0000","last_became_peered":"2023-11-24T06:13:41.947285+0000","last_unstale":"2023-11-24T06:13:41.949058+0000","last_undegraded":"2023-11-24T06:13:41.949058+0000","last_fullsized":"2023-11-24T06:13:41.949058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951973+0000","last_change":"2023-11-24T06:13:41.948433+0000","last_active":"2023-11-24T06:13:41.951973+0000","last_peered":"2023-11-24T06:13:41.951973+0000","last_clean":"2023-11-24T06:13:41.951973+0000","last_became_active":"2023-11-24T06:13:41.947260+0000","last_became_peered":"2023-11-24T06:13:41.947260+0000","last_unstale":"2023-11-24T06:13:41.951973+0000","last_undegraded":"2023-11-24T06:13:41.951973+0000","last_fullsized":"2023-11-24T06:13:41.951973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953503+0000","last_change":"2023-11-24T06:13:40.934891+0000","last_active":"2023-11-24T06:13:41.953503+0000","last_peered":"2023-11-24T06:13:41.953503+0000","last_clean":"2023-11-24T06:13:41.953503+0000","last_became_active":"2023-11-24T06:13:40.934571+0000","last_became_peered":"2023-11-24T06:13:40.934571+0000","last_unstale":"2023-11-24T06:13:41.953503+0000","last_undegraded":"2023-11-24T06:13:41.953503+0000","last_fullsized":"2023-11-24T06:13:41.953503+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956774+0000","last_change":"2023-11-24T06:13:41.951352+0000","last_active":"2023-11-24T06:13:41.956774+0000","last_peered":"2023-11-24T06:13:41.956774+0000","last_clean":"2023-11-24T06:13:41.956774+0000","last_became_active":"2023-11-24T06:13:41.950474+0000","last_became_peered":"2023-11-24T06:13:41.950474+0000","last_unstale":"2023-11-24T06:13:41.956774+0000","last_undegraded":"2023-11-24T06:13:41.956774+0000","last_fullsized":"2023-11-24T06:13:41.956774+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950427+0000","last_change":"2023-11-24T06:13:40.928009+0000","last_active":"2023-11-24T06:13:41.950427+0000","last_peered":"2023-11-24T06:13:41.950427+0000","last_clean":"2023-11-24T06:13:41.950427+0000","last_became_active":"2023-11-24T06:13:40.927708+0000","last_became_peered":"2023-11-24T06:13:40.927708+0000","last_unstale":"2023-11-24T06:13:41.950427+0000","last_undegraded":"2023-11-24T06:13:41.950427+0000","last_fullsized":"2023-11-24T06:13:41.950427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944659+0000","last_change":"2023-11-24T06:13:41.940330+0000","last_active":"2023-11-24T06:13:41.944659+0000","last_peered":"2023-11-24T06:13:41.944659+0000","last_clean":"2023-11-24T06:13:41.944659+0000","last_became_active":"2023-11-24T06:13:41.940009+0000","last_became_peered":"2023-11-24T06:13:41.940009+0000","last_unstale":"2023-11-24T06:13:41.944659+0000","last_undegraded":"2023-11-24T06:13:41.944659+0000","last_fullsized":"2023-11-24T06:13:41.944659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951097+0000","last_change":"2023-11-24T06:13:40.934975+0000","last_active":"2023-11-24T06:13:41.951097+0000","last_peered":"2023-11-24T06:13:41.951097+0000","last_clean":"2023-11-24T06:13:41.951097+0000","last_became_active":"2023-11-24T06:13:40.934687+0000","last_became_peered":"2023-11-24T06:13:40.934687+0000","last_unstale":"2023-11-24T06:13:41.951097+0000","last_undegraded":"2023-11-24T06:13:41.951097+0000","last_fullsized":"2023-11-24T06:13:41.951097+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:14.621591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950728+0000","last_change":"2023-11-24T06:13:41.942453+0000","last_active":"2023-11-24T06:13:41.950728+0000","last_peered":"2023-11-24T06:13:41.950728+0000","last_clean":"2023-11-24T06:13:41.950728+0000","last_became_active":"2023-11-24T06:13:41.942179+0000","last_became_peered":"2023-11-24T06:13:41.942179+0000","last_unstale":"2023-11-24T06:13:41.950728+0000","last_undegraded":"2023-11-24T06:13:41.950728+0000","last_fullsized":"2023-11-24T06:13:41.950728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952530+0000","last_change":"2023-11-24T06:13:40.934902+0000","last_active":"2023-11-24T06:13:41.952530+0000","last_peered":"2023-11-24T06:13:41.952530+0000","last_clean":"2023-11-24T06:13:41.952530+0000","last_became_active":"2023-11-24T06:13:40.934610+0000","last_became_peered":"2023-11-24T06:13:40.934610+0000","last_unstale":"2023-11-24T06:13:41.952530+0000","last_undegraded":"2023-11-24T06:13:41.952530+0000","last_fullsized":"2023-11-24T06:13:41.952530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.959415+0000","last_change":"2023-11-24T06:13:41.954577+0000","last_active":"2023-11-24T06:13:41.959415+0000","last_peered":"2023-11-24T06:13:41.959415+0000","last_clean":"2023-11-24T06:13:41.959415+0000","last_became_active":"2023-11-24T06:13:41.954291+0000","last_became_peered":"2023-11-24T06:13:41.954291+0000","last_unstale":"2023-11-24T06:13:41.959415+0000","last_undegraded":"2023-11-24T06:13:41.959415+0000","last_fullsized":"2023-11-24T06:13:41.959415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952846+0000","last_change":"2023-11-24T06:13:40.934796+0000","last_active":"2023-11-24T06:13:41.952846+0000","last_peered":"2023-11-24T06:13:41.952846+0000","last_clean":"2023-11-24T06:13:41.952846+0000","last_became_active":"2023-11-24T06:13:40.934484+0000","last_became_peered":"2023-11-24T06:13:40.934484+0000","last_unstale":"2023-11-24T06:13:41.952846+0000","last_undegraded":"2023-11-24T06:13:41.952846+0000","last_fullsized":"2023-11-24T06:13:41.952846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:49.659223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.938689+0000","last_change":"2023-11-24T06:13:41.935058+0000","last_active":"2023-11-24T06:13:41.938689+0000","last_peered":"2023-11-24T06:13:41.938689+0000","last_clean":"2023-11-24T06:13:41.938689+0000","last_became_active":"2023-11-24T06:13:41.934769+0000","last_became_peered":"2023-11-24T06:13:41.934769+0000","last_unstale":"2023-11-24T06:13:41.938689+0000","last_undegraded":"2023-11-24T06:13:41.938689+0000","last_fullsized":"2023-11-24T06:13:41.938689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955135+0000","last_change":"2023-11-24T06:13:40.921881+0000","last_active":"2023-11-24T06:13:41.955135+0000","last_peered":"2023-11-24T06:13:41.955135+0000","last_clean":"2023-11-24T06:13:41.955135+0000","last_became_active":"2023-11-24T06:13:40.921653+0000","last_became_peered":"2023-11-24T06:13:40.921653+0000","last_unstale":"2023-11-24T06:13:41.955135+0000","last_undegraded":"2023-11-24T06:13:41.955135+0000","last_fullsized":"2023-11-24T06:13:41.955135+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:42.082565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944742+0000","last_change":"2023-11-24T06:13:41.941156+0000","last_active":"2023-11-24T06:13:41.944742+0000","last_peered":"2023-11-24T06:13:41.944742+0000","last_clean":"2023-11-24T06:13:41.944742+0000","last_became_active":"2023-11-24T06:13:41.940843+0000","last_became_peered":"2023-11-24T06:13:41.940843+0000","last_unstale":"2023-11-24T06:13:41.944742+0000","last_undegraded":"2023-11-24T06:13:41.944742+0000","last_fullsized":"2023-11-24T06:13:41.944742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.932893+0000","last_change":"2023-11-24T06:13:40.926211+0000","last_active":"2023-11-24T06:13:41.932893+0000","last_peered":"2023-11-24T06:13:41.932893+0000","last_clean":"2023-11-24T06:13:41.932893+0000","last_became_active":"2023-11-24T06:13:40.925909+0000","last_became_peered":"2023-11-24T06:13:40.925909+0000","last_unstale":"2023-11-24T06:13:41.932893+0000","last_undegraded":"2023-11-24T06:13:41.932893+0000","last_fullsized":"2023-11-24T06:13:41.932893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944907+0000","last_change":"2023-11-24T06:13:41.938794+0000","last_active":"2023-11-24T06:13:41.944907+0000","last_peered":"2023-11-24T06:13:41.944907+0000","last_clean":"2023-11-24T06:13:41.944907+0000","last_became_active":"2023-11-24T06:13:41.938527+0000","last_became_peered":"2023-11-24T06:13:41.938527+0000","last_unstale":"2023-11-24T06:13:41.944907+0000","last_undegraded":"2023-11-24T06:13:41.944907+0000","last_fullsized":"2023-11-24T06:13:41.944907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931579+0000","last_change":"2023-11-24T06:13:40.933121+0000","last_active":"2023-11-24T06:13:41.931579+0000","last_peered":"2023-11-24T06:13:41.931579+0000","last_clean":"2023-11-24T06:13:41.931579+0000","last_became_active":"2023-11-24T06:13:40.932862+0000","last_became_peered":"2023-11-24T06:13:40.932862+0000","last_unstale":"2023-11-24T06:13:41.931579+0000","last_undegraded":"2023-11-24T06:13:41.931579+0000","last_fullsized":"2023-11-24T06:13:41.931579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954079+0000","last_change":"2023-11-24T06:13:41.946170+0000","last_active":"2023-11-24T06:13:41.954079+0000","last_peered":"2023-11-24T06:13:41.954079+0000","last_clean":"2023-11-24T06:13:41.954079+0000","last_became_active":"2023-11-24T06:13:41.943707+0000","last_became_peered":"2023-11-24T06:13:41.943707+0000","last_unstale":"2023-11-24T06:13:41.954079+0000","last_undegraded":"2023-11-24T06:13:41.954079+0000","last_fullsized":"2023-11-24T06:13:41.954079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.928311+0000","last_change":"2023-11-24T06:13:40.931003+0000","last_active":"2023-11-24T06:13:41.928311+0000","last_peered":"2023-11-24T06:13:41.928311+0000","last_clean":"2023-11-24T06:13:41.928311+0000","last_became_active":"2023-11-24T06:13:40.930726+0000","last_became_peered":"2023-11-24T06:13:40.930726+0000","last_unstale":"2023-11-24T06:13:41.928311+0000","last_undegraded":"2023-11-24T06:13:41.928311+0000","last_fullsized":"2023-11-24T06:13:41.928311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954687+0000","last_change":"2023-11-24T06:13:41.953367+0000","last_active":"2023-11-24T06:13:41.954687+0000","last_peered":"2023-11-24T06:13:41.954687+0000","last_clean":"2023-11-24T06:13:41.954687+0000","last_became_active":"2023-11-24T06:13:41.952985+0000","last_became_peered":"2023-11-24T06:13:41.952985+0000","last_unstale":"2023-11-24T06:13:41.954687+0000","last_undegraded":"2023-11-24T06:13:41.954687+0000","last_fullsized":"2023-11-24T06:13:41.954687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930898+0000","last_change":"2023-11-24T06:13:40.932963+0000","last_active":"2023-11-24T06:13:41.930898+0000","last_peered":"2023-11-24T06:13:41.930898+0000","last_clean":"2023-11-24T06:13:41.930898+0000","last_became_active":"2023-11-24T06:13:40.932634+0000","last_became_peered":"2023-11-24T06:13:40.932634+0000","last_unstale":"2023-11-24T06:13:41.930898+0000","last_undegraded":"2023-11-24T06:13:41.930898+0000","last_fullsized":"2023-11-24T06:13:41.930898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944633+0000","last_change":"2023-11-24T06:13:41.939776+0000","last_active":"2023-11-24T06:13:41.944633+0000","last_peered":"2023-11-24T06:13:41.944633+0000","last_clean":"2023-11-24T06:13:41.944633+0000","last_became_active":"2023-11-24T06:13:41.939488+0000","last_became_peered":"2023-11-24T06:13:41.939488+0000","last_unstale":"2023-11-24T06:13:41.944633+0000","last_undegraded":"2023-11-24T06:13:41.944633+0000","last_fullsized":"2023-11-24T06:13:41.944633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954402+0000","last_change":"2023-11-24T06:13:40.931993+0000","last_active":"2023-11-24T06:13:41.954402+0000","last_peered":"2023-11-24T06:13:41.954402+0000","last_clean":"2023-11-24T06:13:41.954402+0000","last_became_active":"2023-11-24T06:13:40.931611+0000","last_became_peered":"2023-11-24T06:13:40.931611+0000","last_unstale":"2023-11-24T06:13:41.954402+0000","last_undegraded":"2023-11-24T06:13:41.954402+0000","last_fullsized":"2023-11-24T06:13:41.954402+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955102+0000","last_change":"2023-11-24T06:13:41.948915+0000","last_active":"2023-11-24T06:13:41.955102+0000","last_peered":"2023-11-24T06:13:41.955102+0000","last_clean":"2023-11-24T06:13:41.955102+0000","last_became_active":"2023-11-24T06:13:41.948645+0000","last_became_peered":"2023-11-24T06:13:41.948645+0000","last_unstale":"2023-11-24T06:13:41.955102+0000","last_undegraded":"2023-11-24T06:13:41.955102+0000","last_fullsized":"2023-11-24T06:13:41.955102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:30.383021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.962144+0000","last_change":"2023-11-24T06:13:40.926099+0000","last_active":"2023-11-24T06:13:41.962144+0000","last_peered":"2023-11-24T06:13:41.962144+0000","last_clean":"2023-11-24T06:13:41.962144+0000","last_became_active":"2023-11-24T06:13:40.925868+0000","last_became_peered":"2023-11-24T06:13:40.925868+0000","last_unstale":"2023-11-24T06:13:41.962144+0000","last_undegraded":"2023-11-24T06:13:41.962144+0000","last_fullsized":"2023-11-24T06:13:41.962144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951949+0000","last_change":"2023-11-24T06:13:41.948132+0000","last_active":"2023-11-24T06:13:41.951949+0000","last_peered":"2023-11-24T06:13:41.951949+0000","last_clean":"2023-11-24T06:13:41.951949+0000","last_became_active":"2023-11-24T06:13:41.947078+0000","last_became_peered":"2023-11-24T06:13:41.947078+0000","last_unstale":"2023-11-24T06:13:41.951949+0000","last_undegraded":"2023-11-24T06:13:41.951949+0000","last_fullsized":"2023-11-24T06:13:41.951949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955760+0000","last_change":"2023-11-24T06:13:40.929234+0000","last_active":"2023-11-24T06:13:41.955760+0000","last_peered":"2023-11-24T06:13:41.955760+0000","last_clean":"2023-11-24T06:13:41.955760+0000","last_became_active":"2023-11-24T06:13:40.929029+0000","last_became_peered":"2023-11-24T06:13:40.929029+0000","last_unstale":"2023-11-24T06:13:41.955760+0000","last_undegraded":"2023-11-24T06:13:41.955760+0000","last_fullsized":"2023-11-24T06:13:41.955760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.948759+0000","last_change":"2023-11-24T06:13:41.948004+0000","last_active":"2023-11-24T06:13:41.948759+0000","last_peered":"2023-11-24T06:13:41.948759+0000","last_clean":"2023-11-24T06:13:41.948759+0000","last_became_active":"2023-11-24T06:13:41.947739+0000","last_became_peered":"2023-11-24T06:13:41.947739+0000","last_unstale":"2023-11-24T06:13:41.948759+0000","last_undegraded":"2023-11-24T06:13:41.948759+0000","last_fullsized":"2023-11-24T06:13:41.948759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931847+0000","last_change":"2023-11-24T06:13:40.930439+0000","last_active":"2023-11-24T06:13:41.931847+0000","last_peered":"2023-11-24T06:13:41.931847+0000","last_clean":"2023-11-24T06:13:41.931847+0000","last_became_active":"2023-11-24T06:13:40.930080+0000","last_became_peered":"2023-11-24T06:13:40.930080+0000","last_unstale":"2023-11-24T06:13:41.931847+0000","last_undegraded":"2023-11-24T06:13:41.931847+0000","last_fullsized":"2023-11-24T06:13:41.931847+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951975+0000","last_change":"2023-11-24T06:13:41.947175+0000","last_active":"2023-11-24T06:13:41.951975+0000","last_peered":"2023-11-24T06:13:41.951975+0000","last_clean":"2023-11-24T06:13:41.951975+0000","last_became_active":"2023-11-24T06:13:41.946843+0000","last_became_peered":"2023-11-24T06:13:41.946843+0000","last_unstale":"2023-11-24T06:13:41.951975+0000","last_undegraded":"2023-11-24T06:13:41.951975+0000","last_fullsized":"2023-11-24T06:13:41.951975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.928189+0000","last_change":"2023-11-24T06:13:40.921437+0000","last_active":"2023-11-24T06:13:41.928189+0000","last_peered":"2023-11-24T06:13:41.928189+0000","last_clean":"2023-11-24T06:13:41.928189+0000","last_became_active":"2023-11-24T06:13:40.921152+0000","last_became_peered":"2023-11-24T06:13:40.921152+0000","last_unstale":"2023-11-24T06:13:41.928189+0000","last_undegraded":"2023-11-24T06:13:41.928189+0000","last_fullsized":"2023-11-24T06:13:41.928189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946307+0000","last_change":"2023-11-24T06:13:41.936911+0000","last_active":"2023-11-24T06:13:41.946307+0000","last_peered":"2023-11-24T06:13:41.946307+0000","last_clean":"2023-11-24T06:13:41.946307+0000","last_became_active":"2023-11-24T06:13:41.936435+0000","last_became_peered":"2023-11-24T06:13:41.936435+0000","last_unstale":"2023-11-24T06:13:41.946307+0000","last_undegraded":"2023-11-24T06:13:41.946307+0000","last_fullsized":"2023-11-24T06:13:41.946307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:50.987929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955161+0000","last_change":"2023-11-24T06:13:40.931092+0000","last_active":"2023-11-24T06:13:41.955161+0000","last_peered":"2023-11-24T06:13:41.955161+0000","last_clean":"2023-11-24T06:13:41.955161+0000","last_became_active":"2023-11-24T06:13:40.930714+0000","last_became_peered":"2023-11-24T06:13:40.930714+0000","last_unstale":"2023-11-24T06:13:41.955161+0000","last_undegraded":"2023-11-24T06:13:41.955161+0000","last_fullsized":"2023-11-24T06:13:41.955161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951139+0000","last_change":"2023-11-24T06:13:41.946022+0000","last_active":"2023-11-24T06:13:41.951139+0000","last_peered":"2023-11-24T06:13:41.951139+0000","last_clean":"2023-11-24T06:13:41.951139+0000","last_became_active":"2023-11-24T06:13:41.945555+0000","last_became_peered":"2023-11-24T06:13:41.945555+0000","last_unstale":"2023-11-24T06:13:41.951139+0000","last_undegraded":"2023-11-24T06:13:41.951139+0000","last_fullsized":"2023-11-24T06:13:41.951139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954866+0000","last_change":"2023-11-24T06:13:40.928444+0000","last_active":"2023-11-24T06:13:41.954866+0000","last_peered":"2023-11-24T06:13:41.954866+0000","last_clean":"2023-11-24T06:13:41.954866+0000","last_became_active":"2023-11-24T06:13:40.928116+0000","last_became_peered":"2023-11-24T06:13:40.928116+0000","last_unstale":"2023-11-24T06:13:41.954866+0000","last_undegraded":"2023-11-24T06:13:41.954866+0000","last_fullsized":"2023-11-24T06:13:41.954866+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956537+0000","last_change":"2023-11-24T06:13:41.952432+0000","last_active":"2023-11-24T06:13:41.956537+0000","last_peered":"2023-11-24T06:13:41.956537+0000","last_clean":"2023-11-24T06:13:41.956537+0000","last_became_active":"2023-11-24T06:13:41.952182+0000","last_became_peered":"2023-11-24T06:13:41.952182+0000","last_unstale":"2023-11-24T06:13:41.956537+0000","last_undegraded":"2023-11-24T06:13:41.956537+0000","last_fullsized":"2023-11-24T06:13:41.956537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.924483+0000","last_change":"2023-11-24T06:13:40.929215+0000","last_active":"2023-11-24T06:13:41.924483+0000","last_peered":"2023-11-24T06:13:41.924483+0000","last_clean":"2023-11-24T06:13:41.924483+0000","last_became_active":"2023-11-24T06:13:40.928931+0000","last_became_peered":"2023-11-24T06:13:40.928931+0000","last_unstale":"2023-11-24T06:13:41.924483+0000","last_undegraded":"2023-11-24T06:13:41.924483+0000","last_fullsized":"2023-11-24T06:13:41.924483+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950703+0000","last_change":"2023-11-24T06:13:41.944099+0000","last_active":"2023-11-24T06:13:41.950703+0000","last_peered":"2023-11-24T06:13:41.950703+0000","last_clean":"2023-11-24T06:13:41.950703+0000","last_became_active":"2023-11-24T06:13:41.943810+0000","last_became_peered":"2023-11-24T06:13:41.943810+0000","last_unstale":"2023-11-24T06:13:41.950703+0000","last_undegraded":"2023-11-24T06:13:41.950703+0000","last_fullsized":"2023-11-24T06:13:41.950703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931682+0000","last_change":"2023-11-24T06:13:40.931296+0000","last_active":"2023-11-24T06:13:41.931682+0000","last_peered":"2023-11-24T06:13:41.931682+0000","last_clean":"2023-11-24T06:13:41.931682+0000","last_became_active":"2023-11-24T06:13:40.931008+0000","last_became_peered":"2023-11-24T06:13:40.931008+0000","last_unstale":"2023-11-24T06:13:41.931682+0000","last_undegraded":"2023-11-24T06:13:41.931682+0000","last_fullsized":"2023-11-24T06:13:41.931682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.949677+0000","last_change":"2023-11-24T06:13:41.941033+0000","last_active":"2023-11-24T06:13:41.949677+0000","last_peered":"2023-11-24T06:13:41.949677+0000","last_clean":"2023-11-24T06:13:41.949677+0000","last_became_active":"2023-11-24T06:13:41.940774+0000","last_became_peered":"2023-11-24T06:13:41.940774+0000","last_unstale":"2023-11-24T06:13:41.949677+0000","last_undegraded":"2023-11-24T06:13:41.949677+0000","last_fullsized":"2023-11-24T06:13:41.949677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951607+0000","last_change":"2023-11-24T06:13:41.940234+0000","last_active":"2023-11-24T06:13:41.951607+0000","last_peered":"2023-11-24T06:13:41.951607+0000","last_clean":"2023-11-24T06:13:41.951607+0000","last_became_active":"2023-11-24T06:13:41.939983+0000","last_became_peered":"2023-11-24T06:13:41.939983+0000","last_unstale":"2023-11-24T06:13:41.951607+0000","last_undegraded":"2023-11-24T06:13:41.951607+0000","last_fullsized":"2023-11-24T06:13:41.951607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.937048+0000","last_change":"2023-11-24T06:13:40.925168+0000","last_active":"2023-11-24T06:13:41.937048+0000","last_peered":"2023-11-24T06:13:41.937048+0000","last_clean":"2023-11-24T06:13:41.937048+0000","last_became_active":"2023-11-24T06:13:40.924883+0000","last_became_peered":"2023-11-24T06:13:40.924883+0000","last_unstale":"2023-11-24T06:13:41.937048+0000","last_undegraded":"2023-11-24T06:13:41.937048+0000","last_fullsized":"2023-11-24T06:13:41.937048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956820+0000","last_change":"2023-11-24T06:13:41.952514+0000","last_active":"2023-11-24T06:13:41.956820+0000","last_peered":"2023-11-24T06:13:41.956820+0000","last_clean":"2023-11-24T06:13:41.956820+0000","last_became_active":"2023-11-24T06:13:41.952318+0000","last_became_peered":"2023-11-24T06:13:41.952318+0000","last_unstale":"2023-11-24T06:13:41.956820+0000","last_undegraded":"2023-11-24T06:13:41.956820+0000","last_fullsized":"2023-11-24T06:13:41.956820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.929339+0000","last_change":"2023-11-24T06:13:40.928925+0000","last_active":"2023-11-24T06:13:41.929339+0000","last_peered":"2023-11-24T06:13:41.929339+0000","last_clean":"2023-11-24T06:13:41.929339+0000","last_became_active":"2023-11-24T06:13:40.928516+0000","last_became_peered":"2023-11-24T06:13:40.928516+0000","last_unstale":"2023-11-24T06:13:41.929339+0000","last_undegraded":"2023-11-24T06:13:41.929339+0000","last_fullsized":"2023-11-24T06:13:41.929339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-11-24T06:13:40.930048+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:13:40.930048+0000","last_peered":"2023-11-24T06:13:40.930048+0000","last_clean":"2023-11-24T06:13:40.930048+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:13:40.930048+0000","last_undegraded":"2023-11-24T06:13:40.930048+0000","last_fullsized":"2023-11-24T06:13:40.930048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946763+0000","last_change":"2023-11-24T06:13:41.941594+0000","last_active":"2023-11-24T06:13:41.946763+0000","last_peered":"2023-11-24T06:13:41.946763+0000","last_clean":"2023-11-24T06:13:41.946763+0000","last_became_active":"2023-11-24T06:13:41.940870+0000","last_became_peered":"2023-11-24T06:13:41.940870+0000","last_unstale":"2023-11-24T06:13:41.946763+0000","last_undegraded":"2023-11-24T06:13:41.946763+0000","last_fullsized":"2023-11-24T06:13:41.946763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:53:30.383021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931078+0000","last_change":"2023-11-24T06:13:40.936258+0000","last_active":"2023-11-24T06:13:41.931078+0000","last_peered":"2023-11-24T06:13:41.931078+0000","last_clean":"2023-11-24T06:13:41.931078+0000","last_became_active":"2023-11-24T06:13:40.936027+0000","last_became_peered":"2023-11-24T06:13:40.936027+0000","last_unstale":"2023-11-24T06:13:41.931078+0000","last_undegraded":"2023-11-24T06:13:41.931078+0000","last_fullsized":"2023-11-24T06:13:41.931078+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.931500+0000","last_change":"2023-11-24T06:13:40.935763+0000","last_active":"2023-11-24T06:13:41.931500+0000","last_peered":"2023-11-24T06:13:41.931500+0000","last_clean":"2023-11-24T06:13:41.931500+0000","last_became_active":"2023-11-24T06:13:40.935501+0000","last_became_peered":"2023-11-24T06:13:40.935501+0000","last_unstale":"2023-11-24T06:13:41.931500+0000","last_undegraded":"2023-11-24T06:13:41.931500+0000","last_fullsized":"2023-11-24T06:13:41.931500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951556+0000","last_change":"2023-11-24T06:13:41.939692+0000","last_active":"2023-11-24T06:13:41.951556+0000","last_peered":"2023-11-24T06:13:41.951556+0000","last_clean":"2023-11-24T06:13:41.951556+0000","last_became_active":"2023-11-24T06:13:41.939436+0000","last_became_peered":"2023-11-24T06:13:41.939436+0000","last_unstale":"2023-11-24T06:13:41.951556+0000","last_undegraded":"2023-11-24T06:13:41.951556+0000","last_fullsized":"2023-11-24T06:13:41.951556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923883+0000","last_change":"2023-11-24T06:13:40.929038+0000","last_active":"2023-11-24T06:13:41.923883+0000","last_peered":"2023-11-24T06:13:41.923883+0000","last_clean":"2023-11-24T06:13:41.923883+0000","last_became_active":"2023-11-24T06:13:40.928695+0000","last_became_peered":"2023-11-24T06:13:40.928695+0000","last_unstale":"2023-11-24T06:13:41.923883+0000","last_undegraded":"2023-11-24T06:13:41.923883+0000","last_fullsized":"2023-11-24T06:13:41.923883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956758+0000","last_change":"2023-11-24T06:13:41.951155+0000","last_active":"2023-11-24T06:13:41.956758+0000","last_peered":"2023-11-24T06:13:41.956758+0000","last_clean":"2023-11-24T06:13:41.956758+0000","last_became_active":"2023-11-24T06:13:41.950865+0000","last_became_peered":"2023-11-24T06:13:41.950865+0000","last_unstale":"2023-11-24T06:13:41.956758+0000","last_undegraded":"2023-11-24T06:13:41.956758+0000","last_fullsized":"2023-11-24T06:13:41.956758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954248+0000","last_change":"2023-11-24T06:13:40.928532+0000","last_active":"2023-11-24T06:13:41.954248+0000","last_peered":"2023-11-24T06:13:41.954248+0000","last_clean":"2023-11-24T06:13:41.954248+0000","last_became_active":"2023-11-24T06:13:40.928254+0000","last_became_peered":"2023-11-24T06:13:40.928254+0000","last_unstale":"2023-11-24T06:13:41.954248+0000","last_undegraded":"2023-11-24T06:13:41.954248+0000","last_fullsized":"2023-11-24T06:13:41.954248+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.944645+0000","last_change":"2023-11-24T06:13:41.938598+0000","last_active":"2023-11-24T06:13:41.944645+0000","last_peered":"2023-11-24T06:13:41.944645+0000","last_clean":"2023-11-24T06:13:41.944645+0000","last_became_active":"2023-11-24T06:13:41.938250+0000","last_became_peered":"2023-11-24T06:13:41.938250+0000","last_unstale":"2023-11-24T06:13:41.944645+0000","last_undegraded":"2023-11-24T06:13:41.944645+0000","last_fullsized":"2023-11-24T06:13:41.944645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930844+0000","last_change":"2023-11-24T06:13:40.935938+0000","last_active":"2023-11-24T06:13:41.930844+0000","last_peered":"2023-11-24T06:13:41.930844+0000","last_clean":"2023-11-24T06:13:41.930844+0000","last_became_active":"2023-11-24T06:13:40.935654+0000","last_became_peered":"2023-11-24T06:13:40.935654+0000","last_unstale":"2023-11-24T06:13:41.930844+0000","last_undegraded":"2023-11-24T06:13:41.930844+0000","last_fullsized":"2023-11-24T06:13:41.930844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954874+0000","last_change":"2023-11-24T06:13:41.943430+0000","last_active":"2023-11-24T06:13:41.954874+0000","last_peered":"2023-11-24T06:13:41.954874+0000","last_clean":"2023-11-24T06:13:41.954874+0000","last_became_active":"2023-11-24T06:13:41.940218+0000","last_became_peered":"2023-11-24T06:13:41.940218+0000","last_unstale":"2023-11-24T06:13:41.954874+0000","last_undegraded":"2023-11-24T06:13:41.954874+0000","last_fullsized":"2023-11-24T06:13:41.954874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923735+0000","last_change":"2023-11-24T06:13:40.934827+0000","last_active":"2023-11-24T06:13:41.923735+0000","last_peered":"2023-11-24T06:13:41.923735+0000","last_clean":"2023-11-24T06:13:41.923735+0000","last_became_active":"2023-11-24T06:13:40.934569+0000","last_became_peered":"2023-11-24T06:13:40.934569+0000","last_unstale":"2023-11-24T06:13:41.923735+0000","last_undegraded":"2023-11-24T06:13:41.923735+0000","last_fullsized":"2023-11-24T06:13:41.923735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956875+0000","last_change":"2023-11-24T06:13:41.952768+0000","last_active":"2023-11-24T06:13:41.956875+0000","last_peered":"2023-11-24T06:13:41.956875+0000","last_clean":"2023-11-24T06:13:41.956875+0000","last_became_active":"2023-11-24T06:13:41.952505+0000","last_became_peered":"2023-11-24T06:13:41.952505+0000","last_unstale":"2023-11-24T06:13:41.956875+0000","last_undegraded":"2023-11-24T06:13:41.956875+0000","last_fullsized":"2023-11-24T06:13:41.956875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:51:39.298965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.923781+0000","last_change":"2023-11-24T06:13:40.930150+0000","last_active":"2023-11-24T06:13:41.923781+0000","last_peered":"2023-11-24T06:13:41.923781+0000","last_clean":"2023-11-24T06:13:41.923781+0000","last_became_active":"2023-11-24T06:13:40.929863+0000","last_became_peered":"2023-11-24T06:13:40.929863+0000","last_unstale":"2023-11-24T06:13:41.923781+0000","last_undegraded":"2023-11-24T06:13:41.923781+0000","last_fullsized":"2023-11-24T06:13:41.923781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956737+0000","last_change":"2023-11-24T06:13:41.951171+0000","last_active":"2023-11-24T06:13:41.956737+0000","last_peered":"2023-11-24T06:13:41.956737+0000","last_clean":"2023-11-24T06:13:41.956737+0000","last_became_active":"2023-11-24T06:13:41.950836+0000","last_became_peered":"2023-11-24T06:13:41.950836+0000","last_unstale":"2023-11-24T06:13:41.956737+0000","last_undegraded":"2023-11-24T06:13:41.956737+0000","last_fullsized":"2023-11-24T06:13:41.956737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955471+0000","last_change":"2023-11-24T06:13:40.934976+0000","last_active":"2023-11-24T06:13:41.955471+0000","last_peered":"2023-11-24T06:13:41.955471+0000","last_clean":"2023-11-24T06:13:41.955471+0000","last_became_active":"2023-11-24T06:13:40.934665+0000","last_became_peered":"2023-11-24T06:13:40.934665+0000","last_unstale":"2023-11-24T06:13:41.955471+0000","last_undegraded":"2023-11-24T06:13:41.955471+0000","last_fullsized":"2023-11-24T06:13:41.955471+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946304+0000","last_change":"2023-11-24T06:13:41.938322+0000","last_active":"2023-11-24T06:13:41.946304+0000","last_peered":"2023-11-24T06:13:41.946304+0000","last_clean":"2023-11-24T06:13:41.946304+0000","last_became_active":"2023-11-24T06:13:41.938032+0000","last_became_peered":"2023-11-24T06:13:41.938032+0000","last_unstale":"2023-11-24T06:13:41.946304+0000","last_undegraded":"2023-11-24T06:13:41.946304+0000","last_fullsized":"2023-11-24T06:13:41.946304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.936662+0000","last_change":"2023-11-24T06:13:40.931158+0000","last_active":"2023-11-24T06:13:41.936662+0000","last_peered":"2023-11-24T06:13:41.936662+0000","last_clean":"2023-11-24T06:13:41.936662+0000","last_became_active":"2023-11-24T06:13:40.930820+0000","last_became_peered":"2023-11-24T06:13:40.930820+0000","last_unstale":"2023-11-24T06:13:41.936662+0000","last_undegraded":"2023-11-24T06:13:41.936662+0000","last_fullsized":"2023-11-24T06:13:41.936662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.952079+0000","last_change":"2023-11-24T06:13:41.949647+0000","last_active":"2023-11-24T06:13:41.952079+0000","last_peered":"2023-11-24T06:13:41.952079+0000","last_clean":"2023-11-24T06:13:41.952079+0000","last_became_active":"2023-11-24T06:13:41.949346+0000","last_became_peered":"2023-11-24T06:13:41.949346+0000","last_unstale":"2023-11-24T06:13:41.952079+0000","last_undegraded":"2023-11-24T06:13:41.952079+0000","last_fullsized":"2023-11-24T06:13:41.952079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.955430+0000","last_change":"2023-11-24T06:13:40.932491+0000","last_active":"2023-11-24T06:13:41.955430+0000","last_peered":"2023-11-24T06:13:41.955430+0000","last_clean":"2023-11-24T06:13:41.955430+0000","last_became_active":"2023-11-24T06:13:40.932251+0000","last_became_peered":"2023-11-24T06:13:40.932251+0000","last_unstale":"2023-11-24T06:13:41.955430+0000","last_undegraded":"2023-11-24T06:13:41.955430+0000","last_fullsized":"2023-11-24T06:13:41.955430+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.950919+0000","last_change":"2023-11-24T06:13:41.947115+0000","last_active":"2023-11-24T06:13:41.950919+0000","last_peered":"2023-11-24T06:13:41.950919+0000","last_clean":"2023-11-24T06:13:41.950919+0000","last_became_active":"2023-11-24T06:13:41.944203+0000","last_became_peered":"2023-11-24T06:13:41.944203+0000","last_unstale":"2023-11-24T06:13:41.950919+0000","last_undegraded":"2023-11-24T06:13:41.950919+0000","last_fullsized":"2023-11-24T06:13:41.950919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:03.449662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951358+0000","last_change":"2023-11-24T06:13:40.926973+0000","last_active":"2023-11-24T06:13:41.951358+0000","last_peered":"2023-11-24T06:13:41.951358+0000","last_clean":"2023-11-24T06:13:41.951358+0000","last_became_active":"2023-11-24T06:13:40.926745+0000","last_became_peered":"2023-11-24T06:13:40.926745+0000","last_unstale":"2023-11-24T06:13:41.951358+0000","last_undegraded":"2023-11-24T06:13:41.951358+0000","last_fullsized":"2023-11-24T06:13:41.951358+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:57.388385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951887+0000","last_change":"2023-11-24T06:13:41.946697+0000","last_active":"2023-11-24T06:13:41.951887+0000","last_peered":"2023-11-24T06:13:41.951887+0000","last_clean":"2023-11-24T06:13:41.951887+0000","last_became_active":"2023-11-24T06:13:41.946341+0000","last_became_peered":"2023-11-24T06:13:41.946341+0000","last_unstale":"2023-11-24T06:13:41.951887+0000","last_undegraded":"2023-11-24T06:13:41.951887+0000","last_fullsized":"2023-11-24T06:13:41.951887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946285+0000","last_change":"2023-11-24T06:13:41.936743+0000","last_active":"2023-11-24T06:13:41.946285+0000","last_peered":"2023-11-24T06:13:41.946285+0000","last_clean":"2023-11-24T06:13:41.946285+0000","last_became_active":"2023-11-24T06:13:41.936048+0000","last_became_peered":"2023-11-24T06:13:41.936048+0000","last_unstale":"2023-11-24T06:13:41.946285+0000","last_undegraded":"2023-11-24T06:13:41.946285+0000","last_fullsized":"2023-11-24T06:13:41.946285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953807+0000","last_change":"2023-11-24T06:13:41.951555+0000","last_active":"2023-11-24T06:13:41.953807+0000","last_peered":"2023-11-24T06:13:41.953807+0000","last_clean":"2023-11-24T06:13:41.953807+0000","last_became_active":"2023-11-24T06:13:41.951290+0000","last_became_peered":"2023-11-24T06:13:41.951290+0000","last_unstale":"2023-11-24T06:13:41.953807+0000","last_undegraded":"2023-11-24T06:13:41.953807+0000","last_fullsized":"2023-11-24T06:13:41.953807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951400+0000","last_change":"2023-11-24T06:13:41.945563+0000","last_active":"2023-11-24T06:13:41.951400+0000","last_peered":"2023-11-24T06:13:41.951400+0000","last_clean":"2023-11-24T06:13:41.951400+0000","last_became_active":"2023-11-24T06:13:41.943916+0000","last_became_peered":"2023-11-24T06:13:41.943916+0000","last_unstale":"2023-11-24T06:13:41.951400+0000","last_undegraded":"2023-11-24T06:13:41.951400+0000","last_fullsized":"2023-11-24T06:13:41.951400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:30:51.423686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946801+0000","last_change":"2023-11-24T06:13:41.943045+0000","last_active":"2023-11-24T06:13:41.946801+0000","last_peered":"2023-11-24T06:13:41.946801+0000","last_clean":"2023-11-24T06:13:41.946801+0000","last_became_active":"2023-11-24T06:13:41.942182+0000","last_became_peered":"2023-11-24T06:13:41.942182+0000","last_unstale":"2023-11-24T06:13:41.946801+0000","last_undegraded":"2023-11-24T06:13:41.946801+0000","last_fullsized":"2023-11-24T06:13:41.946801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:17.013578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953482+0000","last_change":"2023-11-24T06:13:41.950138+0000","last_active":"2023-11-24T06:13:41.953482+0000","last_peered":"2023-11-24T06:13:41.953482+0000","last_clean":"2023-11-24T06:13:41.953482+0000","last_became_active":"2023-11-24T06:13:41.949872+0000","last_became_peered":"2023-11-24T06:13:41.949872+0000","last_unstale":"2023-11-24T06:13:41.953482+0000","last_undegraded":"2023-11-24T06:13:41.953482+0000","last_fullsized":"2023-11-24T06:13:41.953482+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:01.562975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.954054+0000","last_change":"2023-11-24T06:13:41.942213+0000","last_active":"2023-11-24T06:13:41.954054+0000","last_peered":"2023-11-24T06:13:41.954054+0000","last_clean":"2023-11-24T06:13:41.954054+0000","last_became_active":"2023-11-24T06:13:41.941946+0000","last_became_peered":"2023-11-24T06:13:41.941946+0000","last_unstale":"2023-11-24T06:13:41.954054+0000","last_undegraded":"2023-11-24T06:13:41.954054+0000","last_fullsized":"2023-11-24T06:13:41.954054+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.959502+0000","last_change":"2023-11-24T06:13:41.954479+0000","last_active":"2023-11-24T06:13:41.959502+0000","last_peered":"2023-11-24T06:13:41.959502+0000","last_clean":"2023-11-24T06:13:41.959502+0000","last_became_active":"2023-11-24T06:13:41.954180+0000","last_became_peered":"2023-11-24T06:13:41.954180+0000","last_unstale":"2023-11-24T06:13:41.959502+0000","last_undegraded":"2023-11-24T06:13:41.959502+0000","last_fullsized":"2023-11-24T06:13:41.959502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956623+0000","last_change":"2023-11-24T06:13:41.950255+0000","last_active":"2023-11-24T06:13:41.956623+0000","last_peered":"2023-11-24T06:13:41.956623+0000","last_clean":"2023-11-24T06:13:41.956623+0000","last_became_active":"2023-11-24T06:13:41.949950+0000","last_became_peered":"2023-11-24T06:13:41.949950+0000","last_unstale":"2023-11-24T06:13:41.956623+0000","last_undegraded":"2023-11-24T06:13:41.956623+0000","last_fullsized":"2023-11-24T06:13:41.956623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951105+0000","last_change":"2023-11-24T06:13:41.945908+0000","last_active":"2023-11-24T06:13:41.951105+0000","last_peered":"2023-11-24T06:13:41.951105+0000","last_clean":"2023-11-24T06:13:41.951105+0000","last_became_active":"2023-11-24T06:13:41.945619+0000","last_became_peered":"2023-11-24T06:13:41.945619+0000","last_unstale":"2023-11-24T06:13:41.951105+0000","last_undegraded":"2023-11-24T06:13:41.951105+0000","last_fullsized":"2023-11-24T06:13:41.951105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.956880+0000","last_change":"2023-11-24T06:13:41.955593+0000","last_active":"2023-11-24T06:13:41.956880+0000","last_peered":"2023-11-24T06:13:41.956880+0000","last_clean":"2023-11-24T06:13:41.956880+0000","last_became_active":"2023-11-24T06:13:41.955287+0000","last_became_peered":"2023-11-24T06:13:41.955287+0000","last_unstale":"2023-11-24T06:13:41.956880+0000","last_undegraded":"2023-11-24T06:13:41.956880+0000","last_fullsized":"2023-11-24T06:13:41.956880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.951417+0000","last_change":"2023-11-24T06:13:41.948053+0000","last_active":"2023-11-24T06:13:41.951417+0000","last_peered":"2023-11-24T06:13:41.951417+0000","last_clean":"2023-11-24T06:13:41.951417+0000","last_became_active":"2023-11-24T06:13:41.947768+0000","last_became_peered":"2023-11-24T06:13:41.947768+0000","last_unstale":"2023-11-24T06:13:41.951417+0000","last_undegraded":"2023-11-24T06:13:41.951417+0000","last_fullsized":"2023-11-24T06:13:41.951417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.953209+0000","last_change":"2023-11-24T06:13:41.948146+0000","last_active":"2023-11-24T06:13:41.953209+0000","last_peered":"2023-11-24T06:13:41.953209+0000","last_clean":"2023-11-24T06:13:41.953209+0000","last_became_active":"2023-11-24T06:13:41.947853+0000","last_became_peered":"2023-11-24T06:13:41.947853+0000","last_unstale":"2023-11-24T06:13:41.953209+0000","last_undegraded":"2023-11-24T06:13:41.953209+0000","last_fullsized":"2023-11-24T06:13:41.953209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.946624+0000","last_change":"2023-11-24T06:13:41.939852+0000","last_active":"2023-11-24T06:13:41.946624+0000","last_peered":"2023-11-24T06:13:41.946624+0000","last_clean":"2023-11-24T06:13:41.946624+0000","last_became_active":"2023-11-24T06:13:41.939587+0000","last_became_peered":"2023-11-24T06:13:41.939587+0000","last_unstale":"2023-11-24T06:13:41.946624+0000","last_undegraded":"2023-11-24T06:13:41.946624+0000","last_fullsized":"2023-11-24T06:13:41.946624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":655560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":66222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":648203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":204800,"data_stored":64736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:46.400 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:13:46.401 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-24T06:13:46.401 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-24T06:13:46.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-24T06:13:46.402 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-24T06:13:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.554+0000 7f5523ca1700 1 Processor -- start 2023-11-24T06:13:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.554+0000 7f5523ca1700 1 -- start start 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5523ca1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5523ca1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f551c0b3370 0x7f551c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5523ca1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c0b2030 con 0x7f551c0d1c70 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5523ca1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0b2f50 con 0x7f551c0b3370 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5523ca1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0b22d0 con 0x7f551c15bdd0 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f551c0b3370 0x7f551c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552223e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f551c0d1c70 0x7f551c0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38070/0 (socket says 172.21.15.106:38070) 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552223e700 1 -- 172.21.15.106:0/4044740436 learned_addr learned my addr 172.21.15.106:0/4044740436 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5521a3d700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 -- 172.21.15.106:0/4044740436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 msgr2=0x7f551c1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 -- 172.21.15.106:0/4044740436 >> v1:172.21.15.106:6789/0 conn(0x7f551c0d1c70 legacy=0x7f551c0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 -- 172.21.15.106:0/4044740436 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0b25b0 con 0x7f551c0b3370 2023-11-24T06:13:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5520a3b700 1 -- 172.21.15.106:0/4044740436 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2593849747 0 0) 0x7f551c0b2030 con 0x7f551c0d1c70 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f552123c700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0b3370 0x7f551c0b1af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88da4b65c3b113c2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5520a3b700 1 -- 172.21.15.106:0/4044740436 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c011830 con 0x7f551c0b3370 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5520a3b700 1 -- 172.21.15.106:0/4044740436 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c011990 con 0x7f551c0b3370 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.555+0000 7f5520a3b700 1 -- 172.21.15.106:0/4044740436 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c011d20 con 0x7f551c0b3370 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 -- 172.21.15.106:0/4044740436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0b3370 msgr2=0x7f551c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0b3370 0x7f551c0b1af0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f550c009840 tx=0x7f550c009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 -- 172.21.15.106:0/4044740436 shutdown_connections 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4044740436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0b3370 0x7f551c0b1af0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 -- 172.21.15.106:0/4044740436 >> 172.21.15.106:0/4044740436 conn(0x7f551c0731a0 msgr2=0x7f551c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 -- 172.21.15.106:0/4044740436 shutdown_connections 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.556+0000 7f5523ca1700 1 -- 172.21.15.106:0/4044740436 wait complete. 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.557+0000 7f5523ca1700 1 Processor -- start 2023-11-24T06:13:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 -- start start 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f551c0b3370 0x7f551c157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c15e900 con 0x7f551c0d1c70 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0cec90 con 0x7f551c0b3370 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.558+0000 7f5523ca1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c15dc80 con 0x7f551c15bdd0 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57812/0 (socket says 172.21.15.106:57812) 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 -- 172.21.15.106:0/4026263289 learned_addr learned my addr 172.21.15.106:0/4026263289 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f5521a3d700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f551c0b3370 0x7f551c157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552223e700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 -- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 msgr2=0x7f551c0cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c0cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 -- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f551c0b3370 msgr2=0x7f551c157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f551c0b3370 0x7f551c157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 -- 172.21.15.106:0/4026263289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f550c0094a0 con 0x7f551c0d1c70 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f552123c700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f550c009b90 tx=0x7f550c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c004550 con 0x7f551c0d1c70 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c01f070 con 0x7f551c0d1c70 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c0038e0 con 0x7f551c0d1c70 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c15df60 con 0x7f551c0d1c70 2023-11-24T06:13:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.559+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c15e520 con 0x7f551c0d1c70 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.560+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c15e6e0 con 0x7f551c0d1c70 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.560+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f550c003a40 con 0x7f551c0d1c70 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.561+0000 7f55127fc700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 0x7f550006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.561+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f550c021070 con 0x7f551c0d1c70 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.561+0000 7f5521a3d700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 0x7f550006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.561+0000 7f5521a3d700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 0x7f550006d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5518006b20 tx=0x7f5518008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.565+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f550c055f10 con 0x7f551c0d1c70 2023-11-24T06:13:46.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.810+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f551c067f60 con 0x7f551c0d1c70 2023-11-24T06:13:46.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.813+0000 7f55127fc700 1 -- 172.21.15.106:0/4026263289 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171032 (secure 0 0 0) 0x7f550c02b090 con 0x7f551c0d1c70 2023-11-24T06:13:46.817 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 msgr2=0x7f550006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 0x7f550006d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5518006b20 tx=0x7f5518008040 comp rx=0 tx=0).stop 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 msgr2=0x7f551c0cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f550c009b90 tx=0x7f550c004750 comp rx=0 tx=0).stop 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 shutdown_connections 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f550006aed0 0x7f550006d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f551c15bdd0 0x7f551c0cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f551c0b3370 0x7f551c157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 --2- 172.21.15.106:0/4026263289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f551c0d1c70 0x7f551c0cd6d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 >> 172.21.15.106:0/4026263289 conn(0x7f551c0731a0 msgr2=0x7f551c0aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 shutdown_connections 2023-11-24T06:13:46.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.816+0000 7f5523ca1700 1 -- 172.21.15.106:0/4026263289 wait complete. 2023-11-24T06:13:46.830 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":5,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":822714821},{"type":"v1","addr":"172.21.15.106:6833","nonce":822714821}]},"active_addr":"172.21.15.106:6833/822714821","active_change":"2023-11-24T06:13:21.678923+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":208358901}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":544400408}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":1035490608}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":15949128}]}]} 2023-11-24T06:13:46.833 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-24T06:13:46.833 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-24T06:13:46.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:46.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.950+0000 7f6fe51ee700 1 Processor -- start 2023-11-24T06:13:46.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.950+0000 7f6fe51ee700 1 -- start start 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe015bdd0 0x7f6fe01604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe00b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6fe00d1c70 0x7f6fe00d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00b2f50 con 0x7f6fe015bdd0 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fe00d2660 con 0x7f6fe00d1c70 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fe51ee700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00b2030 con 0x7f6fe00b3370 2023-11-24T06:13:46.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fded9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe015bdd0 0x7f6fe01604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fded9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6fe015bdd0 0x7f6fe01604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57818/0 (socket says 172.21.15.106:57818) 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fded9d700 1 -- 172.21.15.106:0/3495898343 learned_addr learned my addr 172.21.15.106:0/3495898343 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fde59c700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe00b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fdf59e700 1 --2- 172.21.15.106:0/3495898343 >> v2:172.21.15.176:3300/0 conn(0x7f6fe00d1c70 0x7f6fe00d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fded9d700 1 -- 172.21.15.106:0/3495898343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 msgr2=0x7f6fe00b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.951+0000 7f6fded9d700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe00b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fded9d700 1 -- 172.21.15.106:0/3495898343 >> v2:172.21.15.176:3300/0 conn(0x7f6fe00d1c70 msgr2=0x7f6fe00d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fded9d700 1 --2- 172.21.15.106:0/3495898343 >> v2:172.21.15.176:3300/0 conn(0x7f6fe00d1c70 0x7f6fe00d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fded9d700 1 -- 172.21.15.106:0/3495898343 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe00b22d0 con 0x7f6fe015bdd0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fded9d700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe01604e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0160a20 tx=0x7f6fd0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3b84788a0164ac server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fddd9b700 1 -- 172.21.15.106:0/3495898343 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011830 con 0x7f6fe015bdd0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fddd9b700 1 -- 172.21.15.106:0/3495898343 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd0011990 con 0x7f6fe015bdd0 2023-11-24T06:13:46.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.952+0000 7f6fddd9b700 1 -- 172.21.15.106:0/3495898343 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0011d20 con 0x7f6fe015bdd0 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 -- 172.21.15.106:0/3495898343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 msgr2=0x7f6fe01604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe01604e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0160a20 tx=0x7f6fd0009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 -- 172.21.15.106:0/3495898343 shutdown_connections 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/3495898343 >> v2:172.21.15.176:3300/0 conn(0x7f6fe00d1c70 0x7f6fe00d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe01604e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/3495898343 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe00b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 -- 172.21.15.106:0/3495898343 >> 172.21.15.106:0/3495898343 conn(0x7f6fe00731a0 msgr2=0x7f6fe009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 -- 172.21.15.106:0/3495898343 shutdown_connections 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.953+0000 7f6fe51ee700 1 -- 172.21.15.106:0/3495898343 wait complete. 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 Processor -- start 2023-11-24T06:13:46.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 -- start start 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe0156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe00d1c70 0x7f6fe01f7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01f7a00 con 0x7f6fe015bdd0 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00c5ac0 con 0x7f6fe00d1c70 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fe51ee700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe00cb450 con 0x7f6fe00b3370 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fdf59e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fdf59e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57826/0 (socket says 172.21.15.106:57826) 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.955+0000 7f6fdf59e700 1 -- 172.21.15.106:0/2673881877 learned_addr learned my addr 172.21.15.106:0/2673881877 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fde59c700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe00d1c70 0x7f6fe01f7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fded9d700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe0156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.960 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 -- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 msgr2=0x7f6fe0156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe0156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 -- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe00d1c70 msgr2=0x7f6fe01f7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe00d1c70 0x7f6fe01f7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 -- 172.21.15.106:0/2673881877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009550 con 0x7f6fe015bdd0 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fdf59e700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800efc0 tx=0x7f6fd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd8009ea0 con 0x7f6fe015bdd0 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd800f040 con 0x7f6fe015bdd0 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd800ced0 con 0x7f6fe015bdd0 2023-11-24T06:13:46.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00cabb0 con 0x7f6fe015bdd0 2023-11-24T06:13:46.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.956+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe00cb170 con 0x7f6fe015bdd0 2023-11-24T06:13:46.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.957+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe0067f60 con 0x7f6fe015bdd0 2023-11-24T06:13:46.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.958+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6fd8014480 con 0x7f6fe015bdd0 2023-11-24T06:13:46.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.958+0000 7f6fc77fe700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 0x7f6fcc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:46.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.958+0000 7f6fded9d700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 0x7f6fcc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:46.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.958+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fd808a030 con 0x7f6fe015bdd0 2023-11-24T06:13:46.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.958+0000 7f6fded9d700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 0x7f6fcc06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009c10 tx=0x7f6fd0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:46.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:46.963+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6fd8055170 con 0x7f6fe015bdd0 2023-11-24T06:13:47.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.155+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6fe01f7b40 con 0x7f6fe015bdd0 2023-11-24T06:13:47.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.156+0000 7f6fc77fe700 1 -- 172.21.15.106:0/2673881877 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6fe01f7b40 con 0x7f6fe015bdd0 2023-11-24T06:13:47.159 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:47.159 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 msgr2=0x7f6fcc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 0x7f6fcc06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009c10 tx=0x7f6fd0008030 comp rx=0 tx=0).stop 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 msgr2=0x7f6fe00c7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6fd800efc0 tx=0x7f6fd800c3a0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 shutdown_connections 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6fcc06aed0 0x7f6fcc06d390 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fe015bdd0 0x7f6fe00c7ae0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6fe00b3370 0x7f6fe0156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 --2- 172.21.15.106:0/2673881877 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6fe00d1c70 0x7f6fe01f7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 >> 172.21.15.106:0/2673881877 conn(0x7f6fe00731a0 msgr2=0x7f6fe0159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 shutdown_connections 2023-11-24T06:13:47.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.158+0000 7f6fe51ee700 1 -- 172.21.15.106:0/2673881877 wait complete. 2023-11-24T06:13:47.173 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-24T06:13:47.173 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:47.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.290+0000 7f5461fb7700 1 Processor -- start 2023-11-24T06:13:47.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.290+0000 7f5461fb7700 1 -- start start 2023-11-24T06:13:47.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f5461fb7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f545c15e080 0x7f545c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f5461fb7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f5461fb7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c0ae430 con 0x7f545c06c000 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f5461fb7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0af0b0 con 0x7f545c15e080 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f5461fb7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0b05a0 con 0x7f545c0af4d0 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f545c15e080 0x7f545c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545affd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545affd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40054/0 (socket says 172.21.15.106:40054) 2023-11-24T06:13:47.296 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f545c15e080 0x7f545c0b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38070/0 (socket says 172.21.15.106:38070) 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545affd700 1 -- 172.21.15.106:0/2043172796 learned_addr learned my addr 172.21.15.106:0/2043172796 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 -- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 msgr2=0x7f545c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 -- 172.21.15.106:0/2043172796 >> v1:172.21.15.176:6789/0 conn(0x7f545c06c000 legacy=0x7f545c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545b7fe700 1 -- 172.21.15.106:0/2043172796 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c0ae710 con 0x7f545c15e080 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.291+0000 7f545affd700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:47.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f545b7fe700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c0b5050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5450009870 tx=0x7f5450009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8a0b6b7fbf8b9f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f545a7fc700 1 -- 172.21.15.106:0/2043172796 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450011830 con 0x7f545c15e080 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f545a7fc700 1 -- 172.21.15.106:0/2043172796 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5450011990 con 0x7f545c15e080 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f545a7fc700 1 -- 172.21.15.106:0/2043172796 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450011d20 con 0x7f545c15e080 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 -- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 msgr2=0x7f545c0b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c0b5050 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5450009870 tx=0x7f5450009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 -- 172.21.15.106:0/2043172796 shutdown_connections 2023-11-24T06:13:47.298 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c0b5050 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 --2- 172.21.15.106:0/2043172796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 -- 172.21.15.106:0/2043172796 >> 172.21.15.106:0/2043172796 conn(0x7f545c071b90 msgr2=0x7f545c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 -- 172.21.15.106:0/2043172796 shutdown_connections 2023-11-24T06:13:47.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.292+0000 7f5461fb7700 1 -- 172.21.15.106:0/2043172796 wait complete. 2023-11-24T06:13:47.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.293+0000 7f5461fb7700 1 Processor -- start 2023-11-24T06:13:47.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 -- start start 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c15b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c158a60 con 0x7f545c06c000 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c149a50 con 0x7f545c15e080 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.294+0000 7f5461fb7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c157e50 con 0x7f545c0af4d0 2023-11-24T06:13:47.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57838/0 (socket says 172.21.15.106:57838) 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 -- 172.21.15.106:0/570486935 learned_addr learned my addr 172.21.15.106:0/570486935 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545affd700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545bfff700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c15b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 -- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 msgr2=0x7f545c0c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 -- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 msgr2=0x7f545c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c15b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 -- 172.21.15.106:0/570486935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c009550 con 0x7f545c06c000 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545bfff700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f545b7fe700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f54500097c0 tx=0x7f5450004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500045f0 con 0x7f545c06c000 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545001e070 con 0x7f545c06c000 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54500094a0 con 0x7f545c06c000 2023-11-24T06:13:47.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54500038c0 con 0x7f545c06c000 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.295+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c158410 con 0x7f545c06c000 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.296+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c0753f0 con 0x7f545c06c000 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.296+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5450003a20 con 0x7f545c06c000 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.297+0000 7f5443fff700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 0x7f544806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.297+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f545008a5e0 con 0x7f545c06c000 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.297+0000 7f545affd700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 0x7f544806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.297+0000 7f545affd700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 0x7f544806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f545c15cb50 tx=0x7f544c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.301+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5450055680 con 0x7f545c06c000 2023-11-24T06:13:47.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.491+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f545c067f60 con 0x7f545c06c000 2023-11-24T06:13:47.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.493+0000 7f5443fff700 1 -- 172.21.15.106:0/570486935 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f5450020090 con 0x7f545c06c000 2023-11-24T06:13:47.495 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:47.496 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 msgr2=0x7f544806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 0x7f544806d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f545c15cb50 tx=0x7f544c008040 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 msgr2=0x7f545c149510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f54500097c0 tx=0x7f5450004750 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 shutdown_connections 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544806aed0 0x7f544806d390 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c15e080 0x7f545c15b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c06c000 0x7f545c149510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 --2- 172.21.15.106:0/570486935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0af4d0 0x7f545c0c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 >> 172.21.15.106:0/570486935 conn(0x7f545c071b90 msgr2=0x7f545c15d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 shutdown_connections 2023-11-24T06:13:47.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.495+0000 7f5461fb7700 1 -- 172.21.15.106:0/570486935 wait complete. 2023-11-24T06:13:47.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-24T06:13:47.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-24T06:13:47.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-24T06:13:47.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-24T06:13:47.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-24T06:13:47.512 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-24T06:13:47.512 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-24T06:13:47.512 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-24T06:13:47.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.712+0000 7f94f967e700 1 Processor -- start 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.712+0000 7f94f967e700 1 -- start start 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f967e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94f40b3b50 0x7f94f40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f967e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f4164a90 0x7f94f416bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f967e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f406ced0 con 0x7f94f406d4d0 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f967e700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f406da70 con 0x7f94f40b3b50 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f967e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40b4470 con 0x7f94f4164a90 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f2ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94f40b3b50 0x7f94f40b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f2ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f94f40b3b50 0x7f94f40b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57846/0 (socket says 172.21.15.106:57846) 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.713+0000 7f94f2ffd700 1 -- 172.21.15.106:0/3321300175 learned_addr learned my addr 172.21.15.106:0/3321300175 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f2ffd700 1 -- 172.21.15.106:0/3321300175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f4164a90 msgr2=0x7f94f416bee0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f2ffd700 1 --2- 172.21.15.106:0/3321300175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f4164a90 0x7f94f416bee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f2ffd700 1 -- 172.21.15.106:0/3321300175 >> v1:172.21.15.106:6789/0 conn(0x7f94f406d4d0 legacy=0x7f94f406eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f2ffd700 1 -- 172.21.15.106:0/3321300175 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f41634e0 con 0x7f94f40b3b50 2023-11-24T06:13:47.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f2ffd700 1 --2- 172.21.15.106:0/3321300175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f40b3b50 0x7f94f40b3f30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009e50 tx=0x7f94ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd3fa772471fba7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f1ffb700 1 -- 172.21.15.106:0/3321300175 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00e070 con 0x7f94f40b3b50 2023-11-24T06:13:47.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f1ffb700 1 -- 172.21.15.106:0/3321300175 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00b9c0 con 0x7f94f40b3b50 2023-11-24T06:13:47.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.714+0000 7f94f1ffb700 1 -- 172.21.15.106:0/3321300175 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00bd70 con 0x7f94f40b3b50 2023-11-24T06:13:47.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 -- 172.21.15.106:0/3321300175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f40b3b50 msgr2=0x7f94f40b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 --2- 172.21.15.106:0/3321300175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f40b3b50 0x7f94f40b3f30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009e50 tx=0x7f94ec00b330 comp rx=0 tx=0).stop 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 -- 172.21.15.106:0/3321300175 shutdown_connections 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 --2- 172.21.15.106:0/3321300175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f4164a90 0x7f94f416bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 --2- 172.21.15.106:0/3321300175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f40b3b50 0x7f94f40b3f30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 -- 172.21.15.106:0/3321300175 >> 172.21.15.106:0/3321300175 conn(0x7f94f40cfa30 msgr2=0x7f94f40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 -- 172.21.15.106:0/3321300175 shutdown_connections 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.715+0000 7f94f967e700 1 -- 172.21.15.106:0/3321300175 wait complete. 2023-11-24T06:13:47.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.717+0000 7f94f967e700 1 Processor -- start 2023-11-24T06:13:47.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.718+0000 7f94f967e700 1 -- start start 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f406d4d0 0x7f94f4138690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f40b3b50 0x7f94f4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f4164a90 0x7f94f4147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4146a60 con 0x7f94f4164a90 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4070cf0 con 0x7f94f406d4d0 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f967e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4146780 con 0x7f94f40b3b50 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f4164a90 0x7f94f4147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f4164a90 0x7f94f4147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57856/0 (socket says 172.21.15.106:57856) 2023-11-24T06:13:47.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f37fe700 1 -- 172.21.15.106:0/652111990 learned_addr learned my addr 172.21.15.106:0/652111990 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f27fc700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f40b3b50 0x7f94f4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.719+0000 7f94f2ffd700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f406d4d0 0x7f94f4138690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 -- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f406d4d0 msgr2=0x7f94f4138690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f94f406d4d0 0x7f94f4138690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 -- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f4164a90 msgr2=0x7f94f4147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f94f4164a90 0x7f94f4147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009b30 con 0x7f94f40b3b50 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f27fc700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f40b3b50 0x7f94f4149630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94e8000f60 tx=0x7f94e800c730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80052d0 con 0x7f94f40b3b50 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e8005430 con 0x7f94f40b3b50 2023-11-24T06:13:47.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e80038c0 con 0x7f94f40b3b50 2023-11-24T06:13:47.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.720+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f4070f90 con 0x7f94f40b3b50 2023-11-24T06:13:47.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.721+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f4149b70 con 0x7f94f40b3b50 2023-11-24T06:13:47.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f94e8003a20 con 0x7f94f40b3b50 2023-11-24T06:13:47.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7efe694c7700 1 Processor -- start 2023-11-24T06:13:47.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7f94db7fe700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f94e006aed0 0x7f94e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f94f41624b0 con 0x7f94f40b3b50 2023-11-24T06:13:47.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94e8088890 con 0x7f94f40b3b50 2023-11-24T06:13:47.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.722+0000 7f9845f66700 1 Processor -- start 2023-11-24T06:13:47.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.722+0000 7f9845f66700 1 -- start start 2023-11-24T06:13:47.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7f9845f66700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 0x7f984006efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.723+0000 7efe694c7700 1 -- start start 2023-11-24T06:13:47.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7f94db7fe700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7f94e0073070 0x7f94e0075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f94e0075b40 con 0x7f94e0073070 2023-11-24T06:13:47.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7f94f37fe700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7f94e0073070 0x7f94e0075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7f94f37fe700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7f94e0073070 0x7f94e0075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7efe694c7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efe640b4260 0x7efe640714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7efe694c7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640720e0 con 0x7efe64071a10 2023-11-24T06:13:47.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7efe694c7700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe640723c0 con 0x7efe6415d6a0 2023-11-24T06:13:47.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.724+0000 7efe694c7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe64072d60 con 0x7efe640b4260 2023-11-24T06:13:47.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94e80011e0 con 0x7f94f40b3b50 2023-11-24T06:13:47.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe62ffd700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7efe6415d6a0 0x7efe640b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:60602/0 (socket says 172.21.15.106:60602) 2023-11-24T06:13:47.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe62ffd700 1 -- 172.21.15.106:0/1940154039 learned_addr learned my addr 172.21.15.106:0/1940154039 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:47.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe627fc700 1 --2- 172.21.15.106:0/1940154039 >> v2:172.21.15.106:3300/0 conn(0x7efe640b4260 0x7efe640714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7f94f2ffd700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f94e006aed0 0x7f94e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== osd.0 v2:172.21.15.106:6808/4260210820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f94e0075b40 con 0x7f94e0073070 2023-11-24T06:13:47.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe627fc700 1 -- 172.21.15.106:0/1940154039 >> v1:172.21.15.176:6789/0 conn(0x7efe6415d6a0 legacy=0x7efe640b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe627fc700 1 -- 172.21.15.106:0/1940154039 >> v1:172.21.15.106:6789/0 conn(0x7efe64071a10 legacy=0x7efe64140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.725+0000 7efe627fc700 1 -- 172.21.15.106:0/1940154039 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe640726a0 con 0x7efe640b4260 2023-11-24T06:13:47.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.726+0000 7f94f2ffd700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f94e006aed0 0x7f94e006d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000f80 tx=0x7f94ec009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.726+0000 7efe627fc700 1 --2- 172.21.15.106:0/1940154039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe640b4260 0x7efe640714d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe58009840 tx=0x7efe58009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa5c36a2ee9ff00e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.726+0000 7efe61ffb700 1 -- 172.21.15.106:0/1940154039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58004230 con 0x7efe640b4260 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.726+0000 7efe61ffb700 1 -- 172.21.15.106:0/1940154039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58004390 con 0x7efe640b4260 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.726+0000 7efe61ffb700 1 -- 172.21.15.106:0/1940154039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5800f740 con 0x7efe640b4260 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 -- 172.21.15.106:0/1940154039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe640b4260 msgr2=0x7efe640714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 --2- 172.21.15.106:0/1940154039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe640b4260 0x7efe640714d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7efe58009840 tx=0x7efe58009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 -- 172.21.15.106:0/1940154039 shutdown_connections 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 --2- 172.21.15.106:0/1940154039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe640b4260 0x7efe640714d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 -- 172.21.15.106:0/1940154039 >> 172.21.15.106:0/1940154039 conn(0x7efe640cfa30 msgr2=0x7efe640cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 -- 172.21.15.106:0/1940154039 shutdown_connections 2023-11-24T06:13:47.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.727+0000 7efe694c7700 1 -- 172.21.15.106:0/1940154039 wait complete. 2023-11-24T06:13:47.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7efe694c7700 1 Processor -- start 2023-11-24T06:13:47.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7efe694c7700 1 -- start start 2023-11-24T06:13:47.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f9845f66700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 0x7f9840175af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 0x7f984006efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f9845f66700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984008bdb0 con 0x7f984016ae60 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f9845f66700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984006ce30 con 0x7f98400b4260 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983effd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f984016ae60 0x7f98400b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38120/0 (socket says 172.21.15.106:38120) 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983effd700 1 -- 172.21.15.106:0/3580381885 learned_addr learned my addr 172.21.15.106:0/3580381885 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984006d110 con 0x7f9840072bb0 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983ffff700 1 --2- 172.21.15.106:0/3580381885 >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 0x7f9840175af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 -- 172.21.15.106:0/3580381885 >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 msgr2=0x7f9840175af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 --2- 172.21.15.106:0/3580381885 >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 0x7f9840175af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 -- 172.21.15.106:0/3580381885 >> v1:172.21.15.106:6789/0 conn(0x7f984016ae60 legacy=0x7f98400b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 -- 172.21.15.106:0/3580381885 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984006d3f0 con 0x7f9840072bb0 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.729+0000 7f983f7fe700 1 --2- 172.21.15.106:0/3580381885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 0x7f984006efc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9834009840 tx=0x7f9834009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3be68850c8659b28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7f983e7fc700 1 -- 172.21.15.106:0/3580381885 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9834004230 con 0x7f9840072bb0 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7f983e7fc700 1 -- 172.21.15.106:0/3580381885 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9834004390 con 0x7f9840072bb0 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7f983e7fc700 1 -- 172.21.15.106:0/3580381885 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98340036a0 con 0x7f9840072bb0 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 msgr2=0x7f984006efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7f9845f66700 1 --2- 172.21.15.106:0/3580381885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 0x7f984006efc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f9834009840 tx=0x7f9834009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:47.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe64071a10 0x7efe6413bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 0x7efe641582c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe64158800 0x7efe641568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64158c80 con 0x7efe6415d6a0 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe64153200 con 0x7efe64158800 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe694c7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe64157640 con 0x7efe64071a10 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe627fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 0x7efe641582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe627fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 0x7efe641582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57876/0 (socket says 172.21.15.106:57876) 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.730+0000 7efe627fc700 1 -- 172.21.15.106:0/396038190 learned_addr learned my addr 172.21.15.106:0/396038190 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe637fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe64158800 0x7efe641568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe62ffd700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe64071a10 0x7efe6413bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 -- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe64071a10 msgr2=0x7efe6413bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe64071a10 0x7efe6413bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 -- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe64158800 msgr2=0x7efe641568d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe64158800 0x7efe641568d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe580094a0 con 0x7efe6415d6a0 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe62ffd700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efe64071a10 0x7efe6413bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.731+0000 7efe627fc700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 0x7efe641582c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe58004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe637fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efe64158800 0x7efe641568d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:47.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe580036a0 con 0x7efe6415d6a0 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7fee1779a700 1 Processor -- start 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7f983ffff700 1 --2- 172.21.15.106:0/3580381885 >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 0x7f9840175af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 shutdown_connections 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7f9845f66700 1 --2- 172.21.15.106:0/3580381885 >> v2:172.21.15.106:3300/0 conn(0x7f98400b4260 0x7f9840175af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7f9845f66700 1 --2- 172.21.15.106:0/3580381885 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9840072bb0 0x7f984006efc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 >> 172.21.15.106:0/3580381885 conn(0x7f98400cfa30 msgr2=0x7f98400cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe58003800 con 0x7efe6415d6a0 2023-11-24T06:13:47.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58003b90 con 0x7efe6415d6a0 2023-11-24T06:13:47.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe64157920 con 0x7efe6415d6a0 2023-11-24T06:13:47.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe64157ee0 con 0x7efe6415d6a0 2023-11-24T06:13:47.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7f8801f54700 1 Processor -- start 2023-11-24T06:13:47.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efe640cfe10 con 0x7efe6415d6a0 2023-11-24T06:13:47.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7f8801f54700 1 -- start start 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 shutdown_connections 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f9845f66700 1 -- 172.21.15.106:0/3580381885 wait complete. 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f8801f54700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f87fc0d3080 0x7f87fc163580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f8801f54700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b9bf0 0x7f87fc0b2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f8801f54700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87fc0d3460 con 0x7f87fc0b6d20 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f8801f54700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87fc0b3390 con 0x7f87fc0d3080 2023-11-24T06:13:47.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7f8801f54700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc162aa0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.732+0000 7fee1779a700 1 -- start start 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7fee1779a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 0x7fee1006d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7fee1779a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 0x7fee10071970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7fee1779a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee100714e0 con 0x7fee1014be10 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7fee1779a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1014c1f0 con 0x7fee1006efc0 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.733+0000 7fee1779a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee10070bf0 con 0x7fee100b4260 2023-11-24T06:13:47.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee15536700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fee1014be10 0x7fee100b3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38142/0 (socket says 172.21.15.106:38142) 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee15536700 1 -- 172.21.15.106:0/4261461974 learned_addr learned my addr 172.21.15.106:0/4261461974 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 --2- 172.21.15.106:0/4261461974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 0x7fee1006d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee15d37700 1 --2- 172.21.15.106:0/4261461974 >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 0x7fee10071970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 -- 172.21.15.106:0/4261461974 >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 msgr2=0x7fee10071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 --2- 172.21.15.106:0/4261461974 >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 0x7fee10071970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 -- 172.21.15.106:0/4261461974 >> v1:172.21.15.106:6789/0 conn(0x7fee1014be10 legacy=0x7fee100b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 -- 172.21.15.106:0/4261461974 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee10070e90 con 0x7fee100b4260 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee15d37700 1 --2- 172.21.15.106:0/4261461974 >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 0x7fee10071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:47.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee14d35700 1 --2- 172.21.15.106:0/4261461974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 0x7fee1006d4d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee00009840 tx=0x7fee00009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dd35ea4c8893189 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe58003cf0 con 0x7efe6415d6a0 2023-11-24T06:13:47.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fc368921700 1 Processor -- start 2023-11-24T06:13:47.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.734+0000 7fee07fff700 1 -- 172.21.15.106:0/4261461974 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00011830 con 0x7fee100b4260 2023-11-24T06:13:47.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.735+0000 7fee07fff700 1 -- 172.21.15.106:0/4261461974 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00011990 con 0x7fee100b4260 2023-11-24T06:13:47.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.735+0000 7fee07fff700 1 -- 172.21.15.106:0/4261461974 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00011d20 con 0x7fee100b4260 2023-11-24T06:13:47.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.735+0000 7efe4b7fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efe5006af20 0x7efe5006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.735+0000 7efe62ffd700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efe5006af20 0x7efe5006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7f9845f66700 1 Processor -- start 2023-11-24T06:13:47.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 -- 172.21.15.106:0/4261461974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 msgr2=0x7fee1006d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 --2- 172.21.15.106:0/4261461974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 0x7fee1006d4d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fee00009840 tx=0x7fee00009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:47.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.735+0000 7fc368921700 1 -- start start 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 -- 172.21.15.106:0/4261461974 shutdown_connections 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 --2- 172.21.15.106:0/4261461974 >> v2:172.21.15.106:3300/0 conn(0x7fee1006efc0 0x7fee10071970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 --2- 172.21.15.106:0/4261461974 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee100b4260 0x7fee1006d4d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 -- 172.21.15.106:0/4261461974 >> 172.21.15.106:0/4261461974 conn(0x7fee100cfa30 msgr2=0x7fee100cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc368921700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc36415ee90 0x7fc3640622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc368921700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc3640b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc368921700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3640b2bd0 con 0x7fc3640cd870 2023-11-24T06:13:47.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc368921700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3640b1fc0 con 0x7fc36415ee90 2023-11-24T06:13:47.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc368921700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640b22a0 con 0x7fc36415b450 2023-11-24T06:13:47.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7f9845f66700 1 -- start start 2023-11-24T06:13:47.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe58013070 con 0x7efe6415d6a0 2023-11-24T06:13:47.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7efe4b7fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7efe500730c0 0x7efe500754e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efe50075b90 con 0x7efe500730c0 2023-11-24T06:13:47.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7efe637fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7efe500730c0 0x7efe500754e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc361d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc36415ee90 0x7fc3640622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc361d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc36415ee90 0x7fc3640622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38132/0 (socket says 172.21.15.106:38132) 2023-11-24T06:13:47.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc361d9b700 1 -- 172.21.15.106:0/1143010352 learned_addr learned my addr 172.21.15.106:0/1143010352 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fee1779a700 1 -- 172.21.15.106:0/4261461974 shutdown_connections 2023-11-24T06:13:47.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7efe62ffd700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efe5006af20 0x7efe5006d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0012e0 tx=0x7efe5c001990 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7f87fbfff700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f87fc0b6d20 0x7f87fc0d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:60624/0 (socket says 172.21.15.106:60624) 2023-11-24T06:13:47.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7f87fbfff700 1 -- 172.21.15.106:0/954220929 learned_addr learned my addr 172.21.15.106:0/954220929 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:47.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.736+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc3640b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fd2e99ca700 1 Processor -- start 2023-11-24T06:13:47.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7efe637fe700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7efe500730c0 0x7efe500754e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fc361d9b700 1 -- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 msgr2=0x7fc3640b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fc361d9b700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc3640b0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fc361d9b700 1 -- 172.21.15.106:0/1143010352 >> v1:172.21.15.176:6789/0 conn(0x7fc3640cd870 legacy=0x7fc3640af5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fc361d9b700 1 -- 172.21.15.106:0/1143010352 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3640b2580 con 0x7fc36415ee90 2023-11-24T06:13:47.754 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc3640b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe58056190 con 0x7efe6415d6a0 2023-11-24T06:13:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98400b4260 0x7f984020c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 0x7f98401fa4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.755 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98400b3bb0 0x7f9840169480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984020a570 con 0x7f984016ae60 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984020cb60 con 0x7f98400b4260 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f9845f66700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9840209960 con 0x7f98400b3bb0 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f983effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 0x7f98401fa4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f983effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 0x7f98401fa4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57898/0 (socket says 172.21.15.106:57898) 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f983effd700 1 -- 172.21.15.106:0/3762053836 learned_addr learned my addr 172.21.15.106:0/3762053836 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f983ffff700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98400b3bb0 0x7f9840169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.756 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7f983f7fe700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98400b4260 0x7f984020c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f87fa7fc700 1 -- 172.21.15.106:0/954220929 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552667885 0 0) 0x7f87fc0d3460 con 0x7f87fc0b6d20 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f87fa7fc700 1 -- 172.21.15.106:0/954220929 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e40035b0 con 0x7f87fc0b6d20 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 -- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98400b3bb0 msgr2=0x7f9840169480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f98400b3bb0 0x7f9840169480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 -- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98400b4260 msgr2=0x7f984020c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f98400b4260 0x7f984020c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 -- 172.21.15.106:0/3762053836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340094a0 con 0x7f984016ae60 2023-11-24T06:13:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== osd.3 v2:172.21.15.106:6800/85322157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7efe50075b90 con 0x7efe500730c0 2023-11-24T06:13:47.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f983effd700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 0x7f98401fa4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f983000b550 tx=0x7f983000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fd2e99ca700 1 -- start start 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd2e40b4090 0x7fd2e40714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2e4071a10 0x7fd2e406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e4072d60 con 0x7fd2e4071a10 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2e406de80 con 0x7fd2e40b4090 2023-11-24T06:13:47.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e99ca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40b4510 con 0x7fd2e415d6a0 2023-11-24T06:13:47.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830011830 con 0x7f984016ae60 2023-11-24T06:13:47.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98300119b0 con 0x7f984016ae60 2023-11-24T06:13:47.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9830011d60 con 0x7f984016ae60 2023-11-24T06:13:47.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fc361d9b700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640622a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009e50 tx=0x7fc35c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58570ff21654d32a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.737+0000 7fee1779a700 1 -- 172.21.15.106:0/4261461974 wait complete. 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fee1779a700 1 Processor -- start 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2e4071a10 0x7fd2e406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2e4071a10 0x7fd2e406cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57906/0 (socket says 172.21.15.106:57906) 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7fd2e37fe700 1 -- 172.21.15.106:0/2705288609 learned_addr learned my addr 172.21.15.106:0/2705288609 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 -- 172.21.15.106:0/2705288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 msgr2=0x7fd2e40b3b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/2705288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e40b3b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 -- 172.21.15.106:0/2705288609 >> v2:172.21.15.176:3300/0 conn(0x7fd2e40b4090 msgr2=0x7fd2e40714d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:47.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/2705288609 >> v2:172.21.15.176:3300/0 conn(0x7fd2e40b4090 0x7fd2e40714d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 -- 172.21.15.106:0/2705288609 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e4071e70 con 0x7fd2e4071a10 2023-11-24T06:13:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/2705288609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e4071a10 0x7fd2e406cac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e406c450 tx=0x7fd2d4008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2dd21895c17d2e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9840209c40 con 0x7f984016ae60 2023-11-24T06:13:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984020a200 con 0x7f984016ae60 2023-11-24T06:13:47.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fd2e1ffb700 1 -- 172.21.15.106:0/2705288609 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d400b810 con 0x7fd2e4071a10 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7fee1779a700 1 -- start start 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 0x7fee10138320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee100b4260 0x7fee10136bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014be10 0x7fee10133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10134410 con 0x7fee100b4260 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee10137e90 con 0x7fee1014be10 2023-11-24T06:13:47.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fee1779a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee10153d40 con 0x7fee1006efc0 2023-11-24T06:13:47.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fc36159a700 1 -- 172.21.15.106:0/1143010352 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c00e070 con 0x7fc36415ee90 2023-11-24T06:13:47.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fc36159a700 1 -- 172.21.15.106:0/1143010352 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc35c003a20 con 0x7fc36415ee90 2023-11-24T06:13:47.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7fc36159a700 1 -- 172.21.15.106:0/1143010352 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35c003dd0 con 0x7fc36415ee90 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 0x7fee10138320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 0x7fee10138320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40132/0 (socket says 172.21.15.106:40132) 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 -- 172.21.15.106:0/3906033201 learned_addr learned my addr 172.21.15.106:0/3906033201 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 -- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014be10 msgr2=0x7fee10133ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fee1014be10 0x7fee10133ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 -- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee100b4260 msgr2=0x7fee10136bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee100b4260 0x7fee10136bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 -- 172.21.15.106:0/3906033201 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee000094a0 con 0x7fee1006efc0 2023-11-24T06:13:47.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fd2e1ffb700 1 -- 172.21.15.106:0/2705288609 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d400b970 con 0x7fd2e4071a10 2023-11-24T06:13:47.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fd2e1ffb700 1 -- 172.21.15.106:0/2705288609 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d40126f0 con 0x7fd2e4071a10 2023-11-24T06:13:47.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fee15536700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 0x7fee10138320 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c520 tx=0x7fee0c00c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.738+0000 7f87fb7fe700 1 --2- 172.21.15.106:0/954220929 >> v2:172.21.15.176:3300/0 conn(0x7f87fc0d3080 0x7f87fc163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f87fb7fe700 1 -- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b9bf0 msgr2=0x7f87fc0b2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f87fb7fe700 1 --2- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b9bf0 0x7f87fc0b2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f87fb7fe700 1 -- 172.21.15.106:0/954220929 >> v1:172.21.15.176:6789/0 conn(0x7f87fc0b6d20 legacy=0x7f87fc0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.739+0000 7f87fb7fe700 1 -- 172.21.15.106:0/954220929 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87fc162d80 con 0x7f87fc0d3080 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7f87fb7fe700 1 --2- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc163580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009840 tx=0x7f87ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9aedbc7e7064f97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7f87fa7fc700 1 -- 172.21.15.106:0/954220929 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011830 con 0x7f87fc0d3080 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7f87fa7fc700 1 -- 172.21.15.106:0/954220929 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec011990 con 0x7f87fc0d3080 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.740+0000 7f87fa7fc700 1 -- 172.21.15.106:0/954220929 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec011d20 con 0x7f87fc0d3080 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 -- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 msgr2=0x7f87fc163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 --2- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc163580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f87ec009840 tx=0x7f87ec009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 -- 172.21.15.106:0/954220929 shutdown_connections 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 --2- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc163580 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 --2- 172.21.15.106:0/954220929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b9bf0 0x7f87fc0b2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7f8801f54700 1 -- 172.21.15.106:0/954220929 >> 172.21.15.106:0/954220929 conn(0x7f87fc0d3ed0 msgr2=0x7f87fc0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fc368921700 1 -- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 msgr2=0x7fc3640622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.741+0000 7fc368921700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640622a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc35c009e50 tx=0x7fc35c00b330 comp rx=0 tx=0).stop 2023-11-24T06:13:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c005d70 con 0x7fee1006efc0 2023-11-24T06:13:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c0070d0 con 0x7fee1006efc0 2023-11-24T06:13:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c007440 con 0x7fee1006efc0 2023-11-24T06:13:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7f8801f54700 1 -- 172.21.15.106:0/954220929 shutdown_connections 2023-11-24T06:13:47.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 -- 172.21.15.106:0/2705288609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e4071a10 msgr2=0x7fd2e406cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/2705288609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e4071a10 0x7fd2e406cac0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e406c450 tx=0x7fd2d4008c00 comp rx=0 tx=0).stop 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f983001a410 con 0x7f984016ae60 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 -- 172.21.15.106:0/1143010352 shutdown_connections 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc3640b0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 --2- 172.21.15.106:0/1143010352 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640622a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 -- 172.21.15.106:0/1143010352 >> 172.21.15.106:0/1143010352 conn(0x7fc3640b57b0 msgr2=0x7fc3640b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee10137280 con 0x7fee1006efc0 2023-11-24T06:13:47.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee10137840 con 0x7fee1006efc0 2023-11-24T06:13:47.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 -- 172.21.15.106:0/1143010352 shutdown_connections 2023-11-24T06:13:47.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 -- 172.21.15.106:0/2705288609 shutdown_connections 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/2705288609 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e4071a10 0x7fd2e406cac0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/2705288609 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e40b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/2705288609 >> v2:172.21.15.176:3300/0 conn(0x7fd2e40b4090 0x7fd2e40714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fd2e99ca700 1 -- 172.21.15.106:0/2705288609 >> 172.21.15.106:0/2705288609 conn(0x7fd2e40cfa30 msgr2=0x7fd2e40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.743+0000 7f9827fff700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f982c06af00 0x7f982c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.743+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9830088f90 con 0x7f984016ae60 2023-11-24T06:13:47.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.743+0000 7f983f7fe700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f982c06af00 0x7f982c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7f8801f54700 1 -- 172.21.15.106:0/954220929 wait complete. 2023-11-24T06:13:47.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.743+0000 7f8801f54700 1 Processor -- start 2023-11-24T06:13:47.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.744+0000 7f983f7fe700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f982c06af00 0x7f982c06d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98340090b0 tx=0x7f983401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.744+0000 7f8801f54700 1 -- start start 2023-11-24T06:13:47.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.744+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee0c0075a0 con 0x7fee1006efc0 2023-11-24T06:13:47.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.742+0000 7fc368921700 1 -- 172.21.15.106:0/1143010352 wait complete. 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.744+0000 7fc368921700 1 Processor -- start 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b6d20 0x7f87fc0b4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 0x7f87fc0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc0c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b52c0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b55a0 con 0x7f87fc0d3080 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f8801f54700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0b5880 con 0x7f87fc0b6d20 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87fb7fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b6d20 0x7f87fc0b4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 0x7f87fc0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 0x7f87fc0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57924/0 (socket says 172.21.15.106:57924) 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 -- 172.21.15.106:0/1555341479 learned_addr learned my addr 172.21.15.106:0/1555341479 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87fbfff700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc0c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7fd2e99ca700 1 -- 172.21.15.106:0/2705288609 shutdown_connections 2023-11-24T06:13:47.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7fd2e99ca700 1 -- 172.21.15.106:0/2705288609 wait complete. 2023-11-24T06:13:47.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 -- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b6d20 msgr2=0x7f87fc0b4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f87fc0b6d20 0x7f87fc0b4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7fee05ffb700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedf406af20 0x7fedf406d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee0c088910 con 0x7fee1006efc0 2023-11-24T06:13:47.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 -- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 msgr2=0x7f87fc0c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f87fc0d3080 0x7f87fc0c9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7f87faffd700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec0094a0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.745+0000 7fee14d35700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedf406af20 0x7fedf406d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fee14d35700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedf406af20 0x7fedf406d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee10149800 tx=0x7fee00010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f87faffd700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 0x7f87fc0c9750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87f400ba50 tx=0x7f87f400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400c930 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc0cb640 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f400cab0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc0b4eb0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.744+0000 7fc368921700 1 -- start start 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc364152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640ae6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3641599f0 0x7fc36414f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364153470 con 0x7fc3641599f0 2023-11-24T06:13:47.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc364153190 con 0x7fc36415ee90 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc368921700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3640b31e0 con 0x7fc36415b450 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640ae6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc361d9b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640ae6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38166/0 (socket says 172.21.15.106:38166) 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc361d9b700 1 -- 172.21.15.106:0/1158810140 learned_addr learned my addr 172.21.15.106:0/1158810140 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc36259c700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc364152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3641599f0 0x7fc36414f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.746+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f400ce60 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 -- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 msgr2=0x7fc364152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc36415b450 0x7fc364152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 -- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 msgr2=0x7fc3640ae6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640ae6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 -- 172.21.15.106:0/1158810140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc35c009b30 con 0x7fc3641599f0 2023-11-24T06:13:47.782 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc361d9b700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc36415ee90 0x7fc3640ae6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:47.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f87dc000fb0 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc362d9d700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3641599f0 0x7fc36414f4a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7f0 tx=0x7fc35800cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fd2e99ca700 1 Processor -- start 2023-11-24T06:13:47.783 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fd2e99ca700 1 -- start start 2023-11-24T06:13:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358011800 con 0x7fc3641599f0 2023-11-24T06:13:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc358011960 con 0x7fc3641599f0 2023-11-24T06:13:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc358011d10 con 0x7fc3641599f0 2023-11-24T06:13:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3640b34c0 con 0x7fc3641599f0 2023-11-24T06:13:47.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.747+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc364152e60 con 0x7fc3641599f0 2023-11-24T06:13:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.748+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87f401e440 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2e4071a10 0x7fd2e40a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 0x7fd2e4158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e413fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e41ebd70 con 0x7fd2e40b4090 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e40a9c40 con 0x7fd2e4071a10 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e99ca700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2e4158580 con 0x7fd2e415d6a0 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 0x7fd2e4158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 0x7fd2e4158040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57936/0 (socket says 172.21.15.106:57936) 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 -- 172.21.15.106:0/3698696398 learned_addr learned my addr 172.21.15.106:0/3698696398 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e413fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 -- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 msgr2=0x7fd2e413fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd2e415d6a0 0x7fd2e413fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 -- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2e4071a10 msgr2=0x7fd2e40a9700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd2e4071a10 0x7fd2e40a9700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2d40085d0 con 0x7fd2e40b4090 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87e3fff700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f87e806aed0 0x7f87e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87f4006e40 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87e3fff700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7f87e8073070 0x7f87e8075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f87e8075b40 con 0x7f87e8073070 2023-11-24T06:13:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87f408b630 con 0x7f87fc0b9bf0 2023-11-24T06:13:47.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7fd2e27fc700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 0x7fd2e4158040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b5b0 tx=0x7fd2d800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.749+0000 7f87fbfff700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7f87e8073070 0x7f87e8075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7f87fb7fe700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f87e806aed0 0x7f87e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc358022350 con 0x7fc3641599f0 2023-11-24T06:13:47.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7f87fbfff700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7f87e8073070 0x7f87e8075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7f87fb7fe700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f87e806aed0 0x7f87e806d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0090b0 tx=0x7f87ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7fc352ffd700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc34406aed0 0x7fc34406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7fc36259c700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc34406aed0 0x7fc34406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3580894a0 con 0x7fc3641599f0 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.750+0000 7fc36259c700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc34406aed0 0x7fc34406d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc354007fd0 tx=0x7fc354009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fc368921700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7fc3640cd870 0x7fc36415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 --> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc364067f60 con 0x7fc3640cd870 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7f9845f66700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f9840072bb0 0x7f98400b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 --> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f984006cac0 con 0x7f9840072bb0 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7f983ffff700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f9840072bb0 0x7f98400b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7f983ffff700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f9840072bb0 0x7f98400b2e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7facbfbf1700 1 Processor -- start 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7facbfbf1700 1 -- start start 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7facbfbf1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 0x7facb8165e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7facbfbf1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 0x7facb80b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7facbfbf1700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb8072110 con 0x7facb80cf440 2023-11-24T06:13:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7facbfbf1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb8166860 con 0x7facb8070fd0 2023-11-24T06:13:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7facbfbf1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb8071500 con 0x7facb81663d0 2023-11-24T06:13:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbd18c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 0x7facb8165e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7fee1779a700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7fee101623e0 0x7fee10154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 --> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee10072cc0 con 0x7fee101623e0 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d80118f0 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8011a70 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2e41587b0 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8011e20 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.751+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e4158d70 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.752+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2e41ebb10 con 0x7fd2e40b4090 2023-11-24T06:13:47.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbd18c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 0x7facb8165e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38188/0 (socket says 172.21.15.106:38188) 2023-11-24T06:13:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbd18c700 1 -- 172.21.15.106:0/3533966421 learned_addr learned my addr 172.21.15.106:0/3533966421 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7fee15d37700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7fee101623e0 0x7fee10154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 --2- 172.21.15.106:0/3533966421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 0x7facb80b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2d801a400 con 0x7fd2e40b4090 2023-11-24T06:13:47.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 -- 172.21.15.106:0/3533966421 >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 msgr2=0x7facb8165e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:47.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 --2- 172.21.15.106:0/3533966421 >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 0x7facb8165e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 -- 172.21.15.106:0/3533966421 >> v1:172.21.15.176:6789/0 conn(0x7facb80cf440 legacy=0x7facb806e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbc98b700 1 -- 172.21.15.106:0/3533966421 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124909093 0 0) 0x7facb8072110 con 0x7facb80cf440 2023-11-24T06:13:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 -- 172.21.15.106:0/3533966421 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80717e0 con 0x7facb81663d0 2023-11-24T06:13:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7fee15d37700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7fee101623e0 0x7fee10154680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbe18e700 1 --2- 172.21.15.106:0/3533966421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 0x7facb80b2a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7facb0009d90 tx=0x7facb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3a05390d71dce4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== osd.1 v2:172.21.15.106:6824/2882150614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9838007ce0 con 0x7f9840072bb0 2023-11-24T06:13:47.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7fd2cbfff700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd2cc06b0b0 0x7fd2cc06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbc98b700 1 -- 172.21.15.106:0/3533966421 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb000e070 con 0x7facb81663d0 2023-11-24T06:13:47.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbc98b700 1 -- 172.21.15.106:0/3533966421 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb000bbd0 con 0x7facb81663d0 2023-11-24T06:13:47.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.753+0000 7facbc98b700 1 -- 172.21.15.106:0/3533966421 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0012430 con 0x7facb81663d0 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2d8089c30 con 0x7fd2e40b4090 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2e2ffd700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd2cc06b0b0 0x7fd2cc06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2cbfff700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fd2cc0732d0 0x7fd2cc0756f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2cc075da0 con 0x7fd2cc0732d0 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2d808a0d0 con 0x7fd2e40b4090 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fd2cc0732d0 0x7fd2cc0756f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2e2ffd700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd2cc06b0b0 0x7fd2cc06d570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00abb0 tx=0x7fd2dc009250 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.754+0000 7fd2e37fe700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fd2cc0732d0 0x7fd2cc0756f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 -- 172.21.15.106:0/3533966421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 msgr2=0x7facb80b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 --2- 172.21.15.106:0/3533966421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 0x7facb80b2a40 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7facb0009d90 tx=0x7facb000b330 comp rx=0 tx=0).stop 2023-11-24T06:13:47.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== osd.4 v2:172.21.15.176:6824/883773591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f87e8075b40 con 0x7f87e8073070 2023-11-24T06:13:47.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 -- 172.21.15.106:0/3533966421 shutdown_connections 2023-11-24T06:13:47.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 --2- 172.21.15.106:0/3533966421 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb81663d0 0x7facb80b2a40 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 --2- 172.21.15.106:0/3533966421 >> v2:172.21.15.176:3300/0 conn(0x7facb8070fd0 0x7facb8165e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 -- 172.21.15.106:0/3533966421 >> 172.21.15.106:0/3533966421 conn(0x7facb80b1740 msgr2=0x7facb80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 --> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94f4165bf0 con 0x7f94e0073070 2023-11-24T06:13:47.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 -- 172.21.15.106:0/3533966421 shutdown_connections 2023-11-24T06:13:47.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== osd.7 v2:172.21.15.176:6800/1585070888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd2cc075da0 con 0x7fd2cc0732d0 2023-11-24T06:13:47.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94db7fe700 1 -- 172.21.15.106:0/652111990 <== osd.0 v2:172.21.15.106:6808/4260210820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94e40095f0 con 0x7f94e0073070 2023-11-24T06:13:47.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7facbfbf1700 1 -- 172.21.15.106:0/3533966421 wait complete. 2023-11-24T06:13:47.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7f94e0073070 msgr2=0x7f94e0075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7f94e0073070 0x7f94e0075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f94e006aed0 msgr2=0x7f94e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f94e006aed0 0x7f94e006d390 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000f80 tx=0x7f94ec009000 comp rx=0 tx=0).stop 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f40b3b50 msgr2=0x7f94f4149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.756+0000 7f94f967e700 1 --2- 172.21.15.106:0/652111990 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f94f40b3b50 0x7f94f4149630 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f94e8000f60 tx=0x7f94e800c730 comp rx=0 tx=0).stop 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7f94f37fe700 1 -- 172.21.15.106:0/652111990 reap_dead start 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 shutdown_connections 2023-11-24T06:13:47.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 >> 172.21.15.106:0/652111990 conn(0x7f94f40cfa30 msgr2=0x7f94f414f780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 shutdown_connections 2023-11-24T06:13:47.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7f94f967e700 1 -- 172.21.15.106:0/652111990 wait complete. 2023-11-24T06:13:47.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.760+0000 7fc361d9b700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7fc3640cd870 0x7fc36415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.760+0000 7fc361d9b700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7fc3640cd870 0x7fc36415a210 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.755+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== osd.6 v2:172.21.15.176:6808/4287270642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fee0800f040 con 0x7fee101623e0 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7facbfbf1700 1 Processor -- start 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.757+0000 7facbfbf1700 1 -- start start 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 0x7facb8146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb81663d0 0x7facb815f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb815fe60 0x7facb80cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81467b0 con 0x7facb81663d0 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb815e150 con 0x7facb815fe60 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbfbf1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb8146e00 con 0x7facb80cf440 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbd98d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 0x7facb8146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbd98d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 0x7facb8146270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40182/0 (socket says 172.21.15.106:40182) 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbe18e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb815fe60 0x7facb80cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.758+0000 7facbd98d700 1 -- 172.21.15.106:0/1406436003 learned_addr learned my addr 172.21.15.106:0/1406436003 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 -- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 msgr2=0x7facb8146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 0x7facb8146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 -- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb81663d0 msgr2=0x7facb815f920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:13:47.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb81663d0 0x7facb815f920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 -- 172.21.15.106:0/1406436003 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb0009a70 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbd98d700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7facb80cf440 0x7facb8146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbe18e700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb815fe60 0x7facb80cf9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facb0016000 tx=0x7facb0004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0012c20 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0042070 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00098f0 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb81470e0 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.759+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb81476a0 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.761+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facb0004040 con 0x7facb815fe60 2023-11-24T06:13:47.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.761+0000 7facae7fc700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fac9c06aed0 0x7fac9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.762+0000 7facbd98d700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fac9c06aed0 0x7fac9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.762+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb0044070 con 0x7facb815fe60 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.762+0000 7facbd98d700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fac9c06aed0 0x7fac9c06d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faca8000f60 tx=0x7faca8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.766+0000 7facbfbf1700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7facb8147830 0x7facb815bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.766+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 --> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7facb8071da0 con 0x7facb8147830 2023-11-24T06:13:47.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.766+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== osd.5 v2:172.21.15.176:6816/3891434680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc364067f60 con 0x7fc3640cd870 2023-11-24T06:13:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.766+0000 7facbd18c700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7facb8147830 0x7facb815bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.767+0000 7facbd18c700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7facb8147830 0x7facb815bca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:47.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.768+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== osd.2 v2:172.21.15.106:6816/2683231264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7facb4009380 con 0x7facb8147830 2023-11-24T06:13:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.778+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 --> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f87dc002d30 con 0x7f87e8073070 2023-11-24T06:13:47.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f87e3fff700 1 -- 172.21.15.106:0/1555341479 <== osd.4 v2:172.21.15.176:6824/883773591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f87dc002d30 con 0x7f87e8073070 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7f87e8073070 msgr2=0x7f87e8075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7f87e8073070 0x7f87e8075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f87e806aed0 msgr2=0x7f87e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f87e806aed0 0x7f87e806d390 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f87ec0090b0 tx=0x7f87ec008030 comp rx=0 tx=0).stop 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 msgr2=0x7f87fc0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f8801f54700 1 --2- 172.21.15.106:0/1555341479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87fc0b9bf0 0x7f87fc0c9750 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f87f400ba50 tx=0x7f87f400bd60 comp rx=0 tx=0).stop 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.779+0000 7f87fbfff700 1 -- 172.21.15.106:0/1555341479 reap_dead start 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.780+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 shutdown_connections 2023-11-24T06:13:47.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.780+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 >> 172.21.15.106:0/1555341479 conn(0x7f87fc0d3ed0 msgr2=0x7f87fc0cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.780+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 shutdown_connections 2023-11-24T06:13:47.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.780+0000 7f8801f54700 1 -- 172.21.15.106:0/1555341479 wait complete. 2023-11-24T06:13:47.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.782+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 --> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd2e40726a0 con 0x7fd2cc0732d0 2023-11-24T06:13:47.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.782+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 --> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efe64071ec0 con 0x7efe500730c0 2023-11-24T06:13:47.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.782+0000 7fd2cbfff700 1 -- 172.21.15.106:0/3698696398 <== osd.7 v2:172.21.15.176:6800/1585070888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd2d400b790 con 0x7fd2cc0732d0 2023-11-24T06:13:47.816 INFO:teuthology.orchestra.run.smithi106.stdout:55834574857 2023-11-24T06:13:47.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:13:47.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.785+0000 7efe4b7fe700 1 -- 172.21.15.106:0/396038190 <== osd.3 v2:172.21.15.106:6800/85322157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efe54001340 con 0x7efe500730c0 2023-11-24T06:13:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7efe500730c0 msgr2=0x7efe500754e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7efe500730c0 0x7efe500754e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efe5006af20 msgr2=0x7efe5006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efe5006af20 0x7efe5006d3e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efe5c0012e0 tx=0x7efe5c001990 comp rx=0 tx=0).stop 2023-11-24T06:13:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 msgr2=0x7efe641582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe694c7700 1 --2- 172.21.15.106:0/396038190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe6415d6a0 0x7efe641582c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efe580090b0 tx=0x7efe58004750 comp rx=0 tx=0).stop 2023-11-24T06:13:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.786+0000 7efe637fe700 1 -- 172.21.15.106:0/396038190 reap_dead start 2023-11-24T06:13:47.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.787+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 --> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f984006d9b0 con 0x7f9840072bb0 2023-11-24T06:13:47.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9827fff700 1 -- 172.21.15.106:0/3762053836 <== osd.1 v2:172.21.15.106:6824/2882150614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f983800d510 con 0x7f9840072bb0 2023-11-24T06:13:47.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fd2cc0732d0 msgr2=0x7fd2cc0756f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fd2cc0732d0 0x7fd2cc0756f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd2cc06b0b0 msgr2=0x7fd2cc06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd2cc06b0b0 0x7fd2cc06d570 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00abb0 tx=0x7fd2dc009250 comp rx=0 tx=0).stop 2023-11-24T06:13:47.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 msgr2=0x7fd2e4158040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 --2- 172.21.15.106:0/3698696398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2e40b4090 0x7fd2e4158040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800b5b0 tx=0x7fd2d800b8c0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e37fe700 1 -- 172.21.15.106:0/3698696398 reap_dead start 2023-11-24T06:13:47.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 --> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee1006dab0 con 0x7fee101623e0 2023-11-24T06:13:47.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 shutdown_connections 2023-11-24T06:13:47.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 >> 172.21.15.106:0/3698696398 conn(0x7fd2e40cfa30 msgr2=0x7fd2e40af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f9840072bb0 msgr2=0x7f98400b2e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f9840072bb0 0x7f98400b2e10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 shutdown_connections 2023-11-24T06:13:47.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 shutdown_connections 2023-11-24T06:13:47.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 >> 172.21.15.106:0/396038190 conn(0x7efe640cfa30 msgr2=0x7efe640af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fd2e99ca700 1 -- 172.21.15.106:0/3698696398 wait complete. 2023-11-24T06:13:47.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f982c06af00 msgr2=0x7f982c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f982c06af00 0x7f982c06d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f98340090b0 tx=0x7f983401c040 comp rx=0 tx=0).stop 2023-11-24T06:13:47.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 msgr2=0x7f98401fa4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f9845f66700 1 --2- 172.21.15.106:0/3762053836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f984016ae60 0x7f98401fa4b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f983000b550 tx=0x7f983000b860 comp rx=0 tx=0).stop 2023-11-24T06:13:47.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 shutdown_connections 2023-11-24T06:13:47.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7f983ffff700 1 -- 172.21.15.106:0/3762053836 reap_dead start 2023-11-24T06:13:47.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7fee05ffb700 1 -- 172.21.15.106:0/3906033201 <== osd.6 v2:172.21.15.176:6808/4287270642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee080095f0 con 0x7fee101623e0 2023-11-24T06:13:47.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.788+0000 7efe694c7700 1 -- 172.21.15.106:0/396038190 wait complete. 2023-11-24T06:13:47.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 shutdown_connections 2023-11-24T06:13:47.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 >> 172.21.15.106:0/3762053836 conn(0x7f98400cfa30 msgr2=0x7f98400b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7fee101623e0 msgr2=0x7fee10154680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7fee1779a700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7fee101623e0 0x7fee10154680 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 shutdown_connections 2023-11-24T06:13:47.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.789+0000 7f9845f66700 1 -- 172.21.15.106:0/3762053836 wait complete. 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.790+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedf406af20 msgr2=0x7fedf406d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.790+0000 7fee1779a700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedf406af20 0x7fedf406d3e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fee10149800 tx=0x7fee00010000 comp rx=0 tx=0).stop 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.790+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 msgr2=0x7fee10138320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.790+0000 7fee1779a700 1 --2- 172.21.15.106:0/3906033201 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fee1006efc0 0x7fee10138320 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00c520 tx=0x7fee0c00c8e0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.790+0000 7fee15d37700 1 -- 172.21.15.106:0/3906033201 reap_dead start 2023-11-24T06:13:47.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.791+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 shutdown_connections 2023-11-24T06:13:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.791+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 >> 172.21.15.106:0/3906033201 conn(0x7fee100cfa30 msgr2=0x7fee100b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.793+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 shutdown_connections 2023-11-24T06:13:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.793+0000 7fee1779a700 1 -- 172.21.15.106:0/3906033201 wait complete. 2023-11-24T06:13:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.793+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 --> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc364071f00 con 0x7fc3640cd870 2023-11-24T06:13:47.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.794+0000 7fc352ffd700 1 -- 172.21.15.106:0/1158810140 <== osd.5 v2:172.21.15.176:6816/3891434680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc364071f00 con 0x7fc3640cd870 2023-11-24T06:13:47.830 INFO:teuthology.orchestra.run.smithi106.stdout:55834574857 2023-11-24T06:13:47.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:13:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7fc3640cd870 msgr2=0x7fc36415a210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7fc3640cd870 0x7fc36415a210 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 --> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7facb80b2f80 con 0x7facb8147830 2023-11-24T06:13:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc34406aed0 msgr2=0x7fc34406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc34406aed0 0x7fc34406d390 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc354007fd0 tx=0x7fc354009040 comp rx=0 tx=0).stop 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3641599f0 msgr2=0x7fc36414f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 --2- 172.21.15.106:0/1158810140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3641599f0 0x7fc36414f4a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc35800c7f0 tx=0x7fc35800cb00 comp rx=0 tx=0).stop 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc362d9d700 1 -- 172.21.15.106:0/1158810140 reap_dead start 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 shutdown_connections 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 >> 172.21.15.106:0/1158810140 conn(0x7fc3640b57b0 msgr2=0x7fc36406d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 shutdown_connections 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.795+0000 7fc368921700 1 -- 172.21.15.106:0/1158810140 wait complete. 2023-11-24T06:13:47.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facae7fc700 1 -- 172.21.15.106:0/1406436003 <== osd.2 v2:172.21.15.106:6816/2683231264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7facb40096e0 con 0x7facb8147830 2023-11-24T06:13:47.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7facb8147830 msgr2=0x7facb815bca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7facb8147830 0x7facb815bca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fac9c06aed0 msgr2=0x7fac9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fac9c06aed0 0x7fac9c06d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faca8000f60 tx=0x7faca8009040 comp rx=0 tx=0).stop 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb815fe60 msgr2=0x7facb80cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 --2- 172.21.15.106:0/1406436003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7facb815fe60 0x7facb80cf9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7facb0016000 tx=0x7facb0004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbe18e700 1 -- 172.21.15.106:0/1406436003 reap_dead start 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 shutdown_connections 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 >> 172.21.15.106:0/1406436003 conn(0x7facb80b1740 msgr2=0x7facb80b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.796+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 shutdown_connections 2023-11-24T06:13:47.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:47.797+0000 7facbfbf1700 1 -- 172.21.15.106:0/1406436003 wait complete. 2023-11-24T06:13:47.836 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:47.836 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:13:47.837 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:47.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:13:47.839 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:47.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:13:47.840 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:47.840 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:13:47.841 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:47.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:13:47.842 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:47.842 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:13:48.080 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.077+0000 7f0aeb227700 1 Processor -- start 2023-11-24T06:13:48.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.077+0000 7f0aeb227700 1 -- start start 2023-11-24T06:13:48.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.078+0000 7f852ac95700 1 Processor -- start 2023-11-24T06:13:48.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.078+0000 7f852ac95700 1 -- start start 2023-11-24T06:13:48.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0ae40b3b50 0x7f0ae40b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.082 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ae406d4d0 0x7f0ae406eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae4163f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae406ced0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ae406da70 con 0x7f0ae40b3b50 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0aeb227700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae40b4470 con 0x7f0ae4163a80 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0ae3fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ae406d4d0 0x7f0ae406eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0ae3fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ae406d4d0 0x7f0ae406eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57974/0 (socket says 172.21.15.106:57974) 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f0ae3fff700 1 -- 172.21.15.106:0/3567175901 learned_addr learned my addr 172.21.15.106:0/3567175901 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 -- 172.21.15.106:0/3567175901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 msgr2=0x7f0ae4163f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3567175901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae4163f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 -- 172.21.15.106:0/3567175901 >> v2:172.21.15.176:3300/0 conn(0x7f0ae40b3b50 msgr2=0x7f0ae40b3f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.083 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3567175901 >> v2:172.21.15.176:3300/0 conn(0x7f0ae40b3b50 0x7f0ae40b3f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 -- 172.21.15.106:0/3567175901 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ae41634e0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f852ac95700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85240d0520 0x7f852415d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f852ac95700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240b3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f852ac95700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f852415d970 con 0x7f85240b3b50 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f852ac95700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524072d60 con 0x7f85240d0520 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.079+0000 7f852ac95700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852406de80 con 0x7f8524071be0 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8529232700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240b3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8529232700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240b3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40200/0 (socket says 172.21.15.106:40200) 2023-11-24T06:13:48.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8529232700 1 -- 172.21.15.106:0/2573239153 learned_addr learned my addr 172.21.15.106:0/2573239153 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8528a31700 1 --2- 172.21.15.106:0/2573239153 >> v2:172.21.15.106:3300/0 conn(0x7f85240d0520 0x7f852415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3567175901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae406eee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40750c0 tx=0x7f0acc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3548b5f61c223510 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f7d4109f700 1 Processor -- start 2023-11-24T06:13:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8528a31700 1 -- 172.21.15.106:0/2573239153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 msgr2=0x7f85240b3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8528a31700 1 --2- 172.21.15.106:0/2573239153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240b3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8528a31700 1 -- 172.21.15.106:0/2573239153 >> v1:172.21.15.176:6789/0 conn(0x7f85240b3b50 legacy=0x7f85240714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f8528a31700 1 -- 172.21.15.106:0/2573239153 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240723c0 con 0x7f85240d0520 2023-11-24T06:13:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.081+0000 7f8528a31700 1 --2- 172.21.15.106:0/2573239153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240d0520 0x7f852415d430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f8514009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f23185c559ebe9b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.080+0000 7f7d4109f700 1 -- start start 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d4109f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c06c840 0x7f7d3c1435c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d4109f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c06cdb0 con 0x7f7d3c06d930 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d4109f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d3c15da60 con 0x7f7d3c0b2180 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d4109f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c06d090 con 0x7f7d3c06c840 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3b7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7d3c06d930 0x7f7d3c0b2d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38244/0 (socket says 172.21.15.106:38244) 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3b7fe700 1 -- 172.21.15.106:0/1393025993 learned_addr learned my addr 172.21.15.106:0/1393025993 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576689434 0 0) 0x7f7d3c06cdb0 con 0x7f7d3c06d930 2023-11-24T06:13:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d280035b0 con 0x7f7d3c06d930 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f85237fe700 1 -- 172.21.15.106:0/2573239153 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514004230 con 0x7f85240d0520 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f85237fe700 1 -- 172.21.15.106:0/2573239153 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514004390 con 0x7f85240d0520 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f85237fe700 1 -- 172.21.15.106:0/2573239153 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140036a0 con 0x7f85240d0520 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f0ae37fe700 1 -- 172.21.15.106:0/3567175901 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00b870 con 0x7f0ae406d4d0 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f0ae37fe700 1 -- 172.21.15.106:0/3567175901 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0acc00b9d0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f0ae37fe700 1 -- 172.21.15.106:0/3567175901 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0acc00bd60 con 0x7f0ae406d4d0 2023-11-24T06:13:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f0aeb227700 1 -- 172.21.15.106:0/3567175901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 msgr2=0x7f0ae406eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3567175901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae406eee0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0ae40750c0 tx=0x7f0acc009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 740042987 0 0) 0x7f7d280035b0 con 0x7f7d3c06d930 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c06c840 msgr2=0x7f7d3c1435c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c06c840 0x7f7d3c1435c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 >> v1:172.21.15.176:6789/0 conn(0x7f7d3c0b2180 legacy=0x7f7d3c06d220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c15dd40 con 0x7f7d3c06d930 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f7d2c001670 con 0x7f7d3c06d930 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 >> v1:172.21.15.106:6789/0 conn(0x7f7d3c06d930 legacy=0x7f7d3c0b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f7d3affd700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d28003a30 0x7f7d28003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3affd700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d28004850 0x7f7d28004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3affd700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d28005260 0x7f7d28014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c06d090 con 0x7f7d28004850 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28014920 con 0x7f7d28003a30 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d28014ae0 con 0x7f7d28005260 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d28004850 0x7f7d28004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 -- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d28005260 msgr2=0x7f7d28014220 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d28005260 0x7f7d28014220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 -- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d28003a30 msgr2=0x7f7d28003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d28003a30 0x7f7d28003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 -- 172.21.15.106:0/1393025993 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c15dd40 con 0x7f7d28004850 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d28004850 0x7f7d28004cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c01d3a0 tx=0x7f7d28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd022d3b3fcef91 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 -- 172.21.15.106:0/3567175901 shutdown_connections 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3567175901 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae4163f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3567175901 >> v2:172.21.15.176:3300/0 conn(0x7f0ae40b3b50 0x7f0ae40b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3567175901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae406eee0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 -- 172.21.15.106:0/3567175901 >> 172.21.15.106:0/3567175901 conn(0x7f0ae40cfa30 msgr2=0x7f0ae40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c023420 con 0x7f7d28004850 2023-11-24T06:13:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d2c023580 con 0x7f7d28004850 2023-11-24T06:13:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f7d3affd700 1 -- 172.21.15.106:0/1393025993 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2c0238f0 con 0x7f7d28004850 2023-11-24T06:13:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 -- 172.21.15.106:0/3567175901 shutdown_connections 2023-11-24T06:13:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 -- 172.21.15.106:0/2573239153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240d0520 msgr2=0x7f852415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 --2- 172.21.15.106:0/2573239153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240d0520 0x7f852415d430 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8514009870 tx=0x7f8514009b80 comp rx=0 tx=0).stop 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 -- 172.21.15.106:0/2573239153 shutdown_connections 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 --2- 172.21.15.106:0/2573239153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240b3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 --2- 172.21.15.106:0/2573239153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240d0520 0x7f852415d430 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f852ac95700 1 -- 172.21.15.106:0/2573239153 >> 172.21.15.106:0/2573239153 conn(0x7f85240cfa30 msgr2=0x7f85240cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f852ac95700 1 -- 172.21.15.106:0/2573239153 shutdown_connections 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.081+0000 7f4498e32700 1 Processor -- start 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.081+0000 7f4498e32700 1 -- start start 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.082+0000 7f4498e32700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f449416ae60 0x7f449406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f4498e32700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4494072bb0 0x7f44940b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f4498e32700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f449408bdb0 con 0x7f44940b4090 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f4498e32700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44940b4540 con 0x7f449416ae60 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.083+0000 7f4498e32700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449406ce30 con 0x7f4494072bb0 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f449259c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f449416ae60 0x7f449406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f449259c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f449416ae60 0x7f449406efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:57992/0 (socket says 172.21.15.106:57992) 2023-11-24T06:13:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f449259c700 1 -- 172.21.15.106:0/4199847585 learned_addr learned my addr 172.21.15.106:0/4199847585 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365779652 0 0) 0x7f449408bdb0 con 0x7f44940b4090 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f4491d9b700 1 --2- 172.21.15.106:0/4199847585 >> v2:172.21.15.176:3300/0 conn(0x7f4494072bb0 0x7f44940b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f447c0057c0 con 0x7f44940b4090 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 -- 172.21.15.106:0/1393025993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d28004850 msgr2=0x7f7d28004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 --2- 172.21.15.106:0/1393025993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d28004850 0x7f7d28004cd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c01d3a0 tx=0x7f7d28005880 comp rx=0 tx=0).stop 2023-11-24T06:13:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f852ac95700 1 -- 172.21.15.106:0/2573239153 wait complete. 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1463396031 0 0) 0x7f447c0057c0 con 0x7f44940b4090 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 >> v2:172.21.15.176:3300/0 conn(0x7f4494072bb0 msgr2=0x7f44940b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 --2- 172.21.15.106:0/4199847585 >> v2:172.21.15.176:3300/0 conn(0x7f4494072bb0 0x7f44940b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 >> v2:172.21.15.106:3300/0 conn(0x7f449416ae60 msgr2=0x7f449406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 --2- 172.21.15.106:0/4199847585 >> v2:172.21.15.106:3300/0 conn(0x7f449416ae60 0x7f449406efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406d110 con 0x7f44940b4090 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f448c0019f0 con 0x7f44940b4090 2023-11-24T06:13:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 >> v1:172.21.15.106:6789/0 conn(0x7f44940b4090 legacy=0x7f449416e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f447c005c10 0x7f447c006030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4089e700 1 -- 172.21.15.106:0/1393025993 reap_dead start 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 -- 172.21.15.106:0/1393025993 shutdown_connections 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 -- 172.21.15.106:0/1393025993 >> 172.21.15.106:0/1393025993 conn(0x7f7d3c0b1660 msgr2=0x7f7d3c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c006570 0x7f447c006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 0x7f447c00bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44940b4540 con 0x7f447c0070c0 2023-11-24T06:13:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449406ce30 con 0x7f447c006570 2023-11-24T06:13:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f447c00c150 con 0x7f447c005c10 2023-11-24T06:13:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 -- 172.21.15.106:0/1393025993 shutdown_connections 2023-11-24T06:13:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f7d4109f700 1 -- 172.21.15.106:0/1393025993 wait complete. 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.084+0000 7f0aeb227700 1 -- 172.21.15.106:0/3567175901 wait complete. 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f0aeb227700 1 Processor -- start 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.085+0000 7f4492d9d700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 0x7f447c00bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 -- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f447c005c10 msgr2=0x7f447c006030 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f447c005c10 0x7f447c006030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 -- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c006570 msgr2=0x7f447c006a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c006570 0x7f447c006a60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 -- 172.21.15.106:0/4199847585 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449406d110 con 0x7f447c0070c0 2023-11-24T06:13:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 -- 172.21.15.106:0/4199847585 reap_dead start 2023-11-24T06:13:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f4492d9d700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 0x7f447c00bc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f448c00a480 tx=0x7f447c007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837baa1c49cdd281 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f852ac95700 1 Processor -- start 2023-11-24T06:13:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f7d4109f700 1 Processor -- start 2023-11-24T06:13:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c015c80 con 0x7f447c0070c0 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.086+0000 7f0aeb227700 1 -- start start 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ae40b3b50 0x7f0ae4152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae415b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4142ab0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4157070 con 0x7f0ae40b3b50 2023-11-24T06:13:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0aeb227700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ae4157350 con 0x7f0ae4163a80 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0ae8fc3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0ae8fc3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58004/0 (socket says 172.21.15.106:58004) 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f0ae8fc3700 1 -- 172.21.15.106:0/3055844413 learned_addr learned my addr 172.21.15.106:0/3055844413 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae97c4700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae415b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ae40b3b50 0x7f0ae4152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c015e20 con 0x7f447c0070c0 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f449159a700 1 -- 172.21.15.106:0/4199847585 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c01d680 con 0x7f447c0070c0 2023-11-24T06:13:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f4498e32700 1 -- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 msgr2=0x7f447c00bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f4498e32700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 0x7f447c00bc10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f448c00a480 tx=0x7f447c007a90 comp rx=0 tx=0).stop 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.087+0000 7f852ac95700 1 -- start start 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 0x7f85240cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 0x7f85240ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85241518b0 con 0x7f85240b3b50 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8524169f30 con 0x7f85240d0520 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f852ac95700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240af170 con 0x7f8524071be0 2023-11-24T06:13:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8528a31700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8528a31700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40228/0 (socket says 172.21.15.106:40228) 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8528a31700 1 -- 172.21.15.106:0/2716605715 learned_addr learned my addr 172.21.15.106:0/2716605715 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8529232700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 0x7f85240ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8523fff700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 0x7f85240cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8529232700 1 -- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 msgr2=0x7f85240cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8529232700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240cc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f8529232700 1 -- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 msgr2=0x7f85240cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f8529232700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 0x7f85240cc960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f8529232700 1 -- 172.21.15.106:0/2716605715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85140094a0 con 0x7f85240d0520 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae8fc3700 1 -- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 msgr2=0x7f0ae415b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae8fc3700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae415b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae8fc3700 1 -- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ae40b3b50 msgr2=0x7f0ae4152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae8fc3700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ae40b3b50 0x7f0ae4152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f0ae8fc3700 1 -- 172.21.15.106:0/3055844413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc009550 con 0x7f0ae406d4d0 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f0ae8fc3700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ba50 tx=0x7f0ad400bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f8523fff700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 0x7f85240cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f7d4109f700 1 -- start start 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c13f4a0 0x7f7d3c133e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d3c0ce3a0 0x7f7d3c134390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0aadb0 con 0x7f7d3c0ce3a0 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0aa1a0 con 0x7f7d3c13f4a0 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d4109f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d3c0aa480 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f88c8d74700 1 Processor -- start 2023-11-24T06:13:48.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.088+0000 7f88c8d74700 1 -- start start 2023-11-24T06:13:48.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f8529232700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 0x7f85240ccea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f851c00ef90 tx=0x7f851c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d3bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad400c9e0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ad400cb40 con 0x7f0ae406d4d0 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ad4014440 con 0x7f0ae406d4d0 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d3bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40234/0 (socket says 172.21.15.106:40234) 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f7d3bfff700 1 -- 172.21.15.106:0/3770144750 learned_addr learned my addr 172.21.15.106:0/3770144750 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c003c20 con 0x7f85240d0520 2023-11-24T06:13:48.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00f040 con 0x7f85240d0520 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.089+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c009e60 con 0x7f85240d0520 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85240cdfe0 con 0x7f85240d0520 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852414ea60 con 0x7f85240d0520 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 -- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c13f4a0 msgr2=0x7f7d3c133e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c13f4a0 0x7f7d3c133e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 -- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d3c0ce3a0 msgr2=0x7f7d3c134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d3c0ce3a0 0x7f7d3c134390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 -- 172.21.15.106:0/3770144750 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d3c0aa760 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d3bfff700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400b780 tx=0x7f7d3400bb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400f840 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400f9a0 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d3c0aaa40 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d3c0cbec0 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400fd50 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c8d74700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c4072bb0 0x7f88c406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c8d74700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88c40b4260 0x7f88c4070d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c8d74700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c406ce30 con 0x7f88c416abf0 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c8d74700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c406d110 con 0x7f88c40b4260 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c8d74700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c406d3f0 con 0x7f88c4072bb0 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88c40b4260 0x7f88c4070d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f88c40b4260 0x7f88c4070d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38262/0 (socket says 172.21.15.106:38262) 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 -- 172.21.15.106:0/2038051465 learned_addr learned my addr 172.21.15.106:0/2038051465 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 -- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c4072bb0 msgr2=0x7f88c406efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c4072bb0 0x7f88c406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 -- 172.21.15.106:0/2038051465 >> v1:172.21.15.106:6789/0 conn(0x7f88c416abf0 legacy=0x7f88c40b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.090+0000 7f88c2d9d700 1 -- 172.21.15.106:0/2038051465 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c406d6d0 con 0x7f88c40b4260 2023-11-24T06:13:48.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f4498e32700 1 -- 172.21.15.106:0/4199847585 shutdown_connections 2023-11-24T06:13:48.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f4498e32700 1 --2- 172.21.15.106:0/4199847585 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f447c0070c0 0x7f447c00bc10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f4498e32700 1 -- 172.21.15.106:0/4199847585 >> 172.21.15.106:0/4199847585 conn(0x7f44940cfa30 msgr2=0x7f44940cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c40b4260 0x7f88c4070d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88b4014500 tx=0x7f88b4014810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d530683065525ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85040052e0 con 0x7f85240d0520 2023-11-24T06:13:48.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ae4157630 con 0x7f0ae406d4d0 2023-11-24T06:13:48.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ae4157bf0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d200052e0 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.091+0000 7f88c159a700 1 -- 172.21.15.106:0/2038051465 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4004230 con 0x7f88c40b4260 2023-11-24T06:13:48.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.092+0000 7f4498e32700 1 -- 172.21.15.106:0/4199847585 shutdown_connections 2023-11-24T06:13:48.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.092+0000 7f4498e32700 1 -- 172.21.15.106:0/4199847585 wait complete. 2023-11-24T06:13:48.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.092+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d34017400 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ae4157e10 con 0x7f0ae406d4d0 2023-11-24T06:13:48.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f851c00c930 con 0x7f85240d0520 2023-11-24T06:13:48.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f7d38ff9700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 0x7f7d1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d34089930 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 0x7f7d1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f85217fa700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 0x7f850c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.093+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f851c0ac6c0 con 0x7f85240d0520 2023-11-24T06:13:48.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f7d3b7fe700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 0x7f7d1c06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c071f00 tx=0x7f7d2c01a030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f7fb8223700 1 Processor -- start 2023-11-24T06:13:48.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f8528a31700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 0x7f850c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f4498e32700 1 Processor -- start 2023-11-24T06:13:48.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f4498e32700 1 -- start start 2023-11-24T06:13:48.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.094+0000 7f7fb8223700 1 -- start start 2023-11-24T06:13:48.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 0x7f44940ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44941ffb10 0x7f4494203b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44941677a0 con 0x7f44940aecd0 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494167a80 con 0x7f447c0070c0 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4498e32700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4494167d60 con 0x7f44941ffb10 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f449259c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 0x7f44940ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58032/0 (socket says 172.21.15.106:58032) 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f449259c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 0x7f44940ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38268/0 (socket says 172.21.15.106:38268) 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 -- 172.21.15.106:0/3316298966 learned_addr learned my addr 172.21.15.106:0/3316298966 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f7fb8223700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f7fb8223700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb015ee90 0x7f7fb015b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f7fb8223700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb00b2bd0 con 0x7f7fb00b0f80 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f7fb8223700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb00b1fc0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f7fb8223700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00b22a0 con 0x7f7fb015ee90 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 -- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44941ffb10 msgr2=0x7f4494203b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44941ffb10 0x7f4494203b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 -- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 msgr2=0x7f44940ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 0x7f44940ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.095+0000 7f4491d9b700 1 -- 172.21.15.106:0/3316298966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4494168040 con 0x7f44940aecd0 2023-11-24T06:13:48.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58036/0 (socket says 172.21.15.106:58036) 2023-11-24T06:13:48.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/3802520604 learned_addr learned my addr 172.21.15.106:0/3802520604 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb67c0700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb015ee90 0x7f7fb015b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.121 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f4491d9b700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f448800bbd0 tx=0x7f448800bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/3802520604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb015ee90 msgr2=0x7f7fb015b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb015ee90 0x7f7fb015b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/3802520604 >> v1:172.21.15.176:6789/0 conn(0x7f7fb00b0f80 legacy=0x7f7fb00cc760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ad4006d50 con 0x7f0ae406d4d0 2023-11-24T06:13:48.122 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f8528a31700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 0x7f850c06d570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8514009bc0 tx=0x7f8514013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f0ae17fa700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 0x7f0ad006d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ad4089590 con 0x7f0ae406d4d0 2023-11-24T06:13:48.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/3802520604 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb00b2580 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.096+0000 7f7fb5fbf700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00bb90 tx=0x7f7fac00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e73ca8b0e41b34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f88c159a700 1 -- 172.21.15.106:0/2038051465 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b4004390 con 0x7f88c40b4260 2023-11-24T06:13:48.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f88c159a700 1 -- 172.21.15.106:0/2038051465 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b40036a0 con 0x7f88c40b4260 2023-11-24T06:13:48.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 0x7f0ad006d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f851c077750 con 0x7f85240d0520 2023-11-24T06:13:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.097+0000 7f0ae3fff700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 0x7f0ad006d5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc014040 tx=0x7f0acc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 -- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c40b4260 msgr2=0x7f88c4070d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 --2- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c40b4260 0x7f88c4070d00 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f88b4014500 tx=0x7f88b4014810 comp rx=0 tx=0).stop 2023-11-24T06:13:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7fb613900700 1 Processor -- start 2023-11-24T06:13:48.125 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 -- 172.21.15.106:0/2038051465 shutdown_connections 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 --2- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c40b4260 0x7f88c4070d00 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 --2- 172.21.15.106:0/2038051465 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c4072bb0 0x7f88c406efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 -- 172.21.15.106:0/2038051465 >> 172.21.15.106:0/2038051465 conn(0x7f88c40cfa30 msgr2=0x7f88c40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f88c8d74700 1 -- 172.21.15.106:0/2038051465 shutdown_connections 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7fb613900700 1 -- start start 2023-11-24T06:13:48.126 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.098+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d34054a70 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb613900700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15e1e0 0x7fb60c0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb613900700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0d20b0 con 0x7fb60c0d0f80 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb613900700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb60c0d2390 con 0x7fb60c0d3a00 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb613900700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0d3150 con 0x7fb60c15e1e0 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb611e9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb60c0d0f80 0x7fb60c0b6ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38310/0 (socket says 172.21.15.106:38310) 2023-11-24T06:13:48.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb611e9d700 1 -- 172.21.15.106:0/940834826 learned_addr learned my addr 172.21.15.106:0/940834826 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7f88c8d74700 1 -- 172.21.15.106:0/2038051465 wait complete. 2023-11-24T06:13:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.099+0000 7fb61169c700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15e1e0 0x7fb60c0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.100+0000 7f45f4c94700 1 Processor -- start 2023-11-24T06:13:48.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.100+0000 7f45f4c94700 1 -- start start 2023-11-24T06:13:48.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f88c8d74700 1 Processor -- start 2023-11-24T06:13:48.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45f4c94700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f88c8d74700 1 -- start start 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45f4c94700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f45f00b2870 0x7f45f00afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45f4c94700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f015c540 con 0x7f45f00b02e0 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45f4c94700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f00b2cf0 con 0x7f45f00b2870 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45f4c94700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00b0770 con 0x7f45f015c160 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45ee59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45ee59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40270/0 (socket says 172.21.15.106:40270) 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.101+0000 7f45ee59c700 1 -- 172.21.15.106:0/3143728581 learned_addr learned my addr 172.21.15.106:0/3143728581 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ee59c700 1 -- 172.21.15.106:0/3143728581 >> v2:172.21.15.106:3300/0 conn(0x7f45f00b2870 msgr2=0x7f45f00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ee59c700 1 --2- 172.21.15.106:0/3143728581 >> v2:172.21.15.106:3300/0 conn(0x7f45f00b2870 0x7f45f00afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ee59c700 1 -- 172.21.15.106:0/3143728581 >> v1:172.21.15.106:6789/0 conn(0x7f45f00b02e0 legacy=0x7f45f00ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ee59c700 1 -- 172.21.15.106:0/3143728581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00b2ee0 con 0x7f45f015c160 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ee59c700 1 --2- 172.21.15.106:0/3143728581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45e00098f0 tx=0x7f45e0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40c934be3027c1f9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ed59a700 1 -- 172.21.15.106:0/3143728581 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000b8a0 con 0x7f45f015c160 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ed59a700 1 -- 172.21.15.106:0/3143728581 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000ba00 con 0x7f45f015c160 2023-11-24T06:13:48.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f45ed59a700 1 -- 172.21.15.106:0/3143728581 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000bd90 con 0x7f45f015c160 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 0x7f88c40adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 0x7f88c408a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 0x7f88c416e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ae400 con 0x7f88c416abf0 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ae6c0 con 0x7f88c4163a00 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c8d74700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40ae9a0 con 0x7f88c40b4260 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c259c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 0x7f88c40adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c259c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 0x7f88c40adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40276/0 (socket says 172.21.15.106:40276) 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c259c700 1 -- 172.21.15.106:0/1228676819 learned_addr learned my addr 172.21.15.106:0/1228676819 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 0x7f88c416e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.102+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322222103 0 0) 0x7fb60c0d20b0 con 0x7fb60c0d0f80 2023-11-24T06:13:48.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f80035b0 con 0x7fb60c0d0f80 2023-11-24T06:13:48.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488008850 con 0x7f44940aecd0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c1d9b700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 0x7f88c408a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488013070 con 0x7f44940aecd0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488008bd0 con 0x7f44940aecd0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494168320 con 0x7f44940aecd0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940af330 con 0x7f44940aecd0 2023-11-24T06:13:48.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 -- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 msgr2=0x7f88c40adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 0x7f88c40adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 -- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 msgr2=0x7f88c408a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 0x7f88c408a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 -- 172.21.15.106:0/1228676819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b400fd90 con 0x7f88c4163a00 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c1d9b700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 0x7f88c408a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 6696338 0 0) 0x7fb5f80035b0 con 0x7fb60c0d0f80 2023-11-24T06:13:48.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15e1e0 msgr2=0x7fb60c0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15e1e0 0x7fb60c0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 >> v1:172.21.15.176:6789/0 conn(0x7fb60c0d3a00 legacy=0x7fb60c0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0d2670 con 0x7fb60c0d0f80 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb6040019f0 con 0x7fb60c0d0f80 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c2d9d700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 0x7f88c416e500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f88b401d000 tx=0x7f88b4004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 >> v1:172.21.15.106:6789/0 conn(0x7fb60c0d0f80 legacy=0x7fb60c0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f8003a30 0x7fb5f8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f8004850 0x7fb5f8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb5f800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0d3150 con 0x7fb5f8005210 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f800c0f0 con 0x7fb5f8003a30 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f800c2b0 con 0x7fb5f8004850 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4015650 con 0x7f88c4163a00 2023-11-24T06:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b40157b0 con 0x7f88c4163a00 2023-11-24T06:13:48.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4015b60 con 0x7f88c4163a00 2023-11-24T06:13:48.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ad4054620 con 0x7f0ae406d4d0 2023-11-24T06:13:48.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 -- 172.21.15.106:0/3143728581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 msgr2=0x7f45f00622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 --2- 172.21.15.106:0/3143728581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f45e00098f0 tx=0x7f45e0009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:48.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7fb611e9d700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb5f800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 -- 172.21.15.106:0/3143728581 shutdown_connections 2023-11-24T06:13:48.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 --2- 172.21.15.106:0/3143728581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f015c160 0x7f45f00622a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 --2- 172.21.15.106:0/3143728581 >> v2:172.21.15.106:3300/0 conn(0x7f45f00b2870 0x7f45f00afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f45f4c94700 1 -- 172.21.15.106:0/3143728581 >> 172.21.15.106:0/3143728581 conn(0x7f45f00b57b0 msgr2=0x7f45f00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7f45f4c94700 1 -- 172.21.15.106:0/3143728581 shutdown_connections 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7fb611e9d700 1 -- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f8004850 msgr2=0x7fb5f8004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7fb611e9d700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5f8004850 0x7fb5f8004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7fb611e9d700 1 -- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f8003a30 msgr2=0x7fb5f8003e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7fb611e9d700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5f8003a30 0x7fb5f8003e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7fb611e9d700 1 -- 172.21.15.106:0/940834826 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f80035b0 con 0x7fb5f8005210 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c40aec80 con 0x7f88c4163a00 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.103+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c40ae050 con 0x7f88c4163a00 2023-11-24T06:13:48.140 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c40ae050 con 0x7f88c4163a00 2023-11-24T06:13:48.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.105+0000 7fb611e9d700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb5f800ba10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb60400a780 tx=0x7fb5f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45e9b76ecea5023 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.104+0000 7f45f4c94700 1 -- 172.21.15.106:0/3143728581 wait complete. 2023-11-24T06:13:48.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.105+0000 7f45f4c94700 1 Processor -- start 2023-11-24T06:13:48.141 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 -- start start 2023-11-24T06:13:48.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4488008d30 con 0x7f44940aecd0 2023-11-24T06:13:48.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f88b4015cc0 con 0x7f88c4163a00 2023-11-24T06:13:48.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040072d0 con 0x7fb5f8005210 2023-11-24T06:13:48.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb604007430 con 0x7fb5f8005210 2023-11-24T06:13:48.142 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7fb603fff700 1 -- 172.21.15.106:0/940834826 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6040077e0 con 0x7fb5f8005210 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f88b2ffd700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 0x7f88a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f00b02e0 0x7f45f01f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 0x7f45f01f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f015cb50 con 0x7f45f015c160 2023-11-24T06:13:48.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01f34f0 con 0x7f45f00b02e0 2023-11-24T06:13:48.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f45f4c94700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f01f37d0 con 0x7f45f00b2870 2023-11-24T06:13:48.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f4482ffd700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 0x7f447406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.106+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4488015070 con 0x7f44940aecd0 2023-11-24T06:13:48.144 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88b4094b80 con 0x7f88c4163a00 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40286/0 (socket says 172.21.15.106:40286) 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45ee59c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f00b02e0 0x7f45f01f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 -- 172.21.15.106:0/1635878106 learned_addr learned my addr 172.21.15.106:0/1635878106 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45eed9d700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 0x7f45f01f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.145 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f449259c700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 0x7f447406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 -- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f00b02e0 msgr2=0x7f45f01f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f00b02e0 0x7f45f01f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 -- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 msgr2=0x7f45f01f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 0x7f45f01f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 -- 172.21.15.106:0/1635878106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e0009550 con 0x7f45f00b2870 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45eed9d700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 0x7f45f01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7fb613900700 1 -- 172.21.15.106:0/940834826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 msgr2=0x7fb5f800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7fb613900700 1 --2- 172.21.15.106:0/940834826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb5f800ba10 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb60400a780 tx=0x7fb5f8005880 comp rx=0 tx=0).stop 2023-11-24T06:13:48.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7fb611e9d700 1 -- 172.21.15.106:0/940834826 reap_dead start 2023-11-24T06:13:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45edd9b700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b530 tx=0x7f45e400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7fb613900700 1 -- 172.21.15.106:0/940834826 shutdown_connections 2023-11-24T06:13:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7fb613900700 1 -- 172.21.15.106:0/940834826 >> 172.21.15.106:0/940834826 conn(0x7fb60c0b5b50 msgr2=0x7fb60c0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011830 con 0x7f45f00b2870 2023-11-24T06:13:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f449259c700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 0x7f447406d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4494069df0 tx=0x7f448400c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e4011990 con 0x7f45f00b2870 2023-11-24T06:13:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.107+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f01f3ab0 con 0x7f45f00b2870 2023-11-24T06:13:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.108+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4011d20 con 0x7f45f00b2870 2023-11-24T06:13:48.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.108+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f01f3190 con 0x7f45f00b2870 2023-11-24T06:13:48.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.108+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f015cc90 con 0x7f45f00b2870 2023-11-24T06:13:48.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f7fb4fbd700 1 -- 172.21.15.106:0/3802520604 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac00dcf0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f7fb4fbd700 1 -- 172.21.15.106:0/3802520604 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac00de50 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f7fb4fbd700 1 -- 172.21.15.106:0/3802520604 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac004250 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.149 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f88c259c700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 0x7f88a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f88c259c700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 0x7f88a406d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009f10 tx=0x7f88bc0098f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f45e401a400 con 0x7f45f00b2870 2023-11-24T06:13:48.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.109+0000 7fb613900700 1 -- 172.21.15.106:0/940834826 shutdown_connections 2023-11-24T06:13:48.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f45deffd700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 0x7f45d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 -- 172.21.15.106:0/3802520604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 msgr2=0x7f7fb00af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00bb90 tx=0x7f7fac00bea0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 -- 172.21.15.106:0/3802520604 shutdown_connections 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb015ee90 0x7f7fb015b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 --2- 172.21.15.106:0/3802520604 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f7fb8223700 1 -- 172.21.15.106:0/3802520604 >> 172.21.15.106:0/3802520604 conn(0x7f7fb00b57b0 msgr2=0x7f7fb00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7fb613900700 1 -- 172.21.15.106:0/940834826 wait complete. 2023-11-24T06:13:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45e40896f0 con 0x7f45f00b2870 2023-11-24T06:13:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f45ee59c700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 0x7f45d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.110+0000 7f45ee59c700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 0x7f45d006d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f45e0014040 tx=0x7f45e0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.111+0000 7fb613900700 1 Processor -- start 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 -- start start 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb60c150f90 0x7fb60c15ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15bf70 0x7fb60c13fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c151820 con 0x7fb5f8005210 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c15b270 con 0x7fb60c150f90 2023-11-24T06:13:48.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb613900700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb60c0cb690 con 0x7fb60c15bf70 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb61169c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb61169c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58076/0 (socket says 172.21.15.106:58076) 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb61169c700 1 -- 172.21.15.106:0/592672865 learned_addr learned my addr 172.21.15.106:0/592672865 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.112+0000 7fb611e9d700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15bf70 0x7fb60c13fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 -- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15bf70 msgr2=0x7fb60c13fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15bf70 0x7fb60c13fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 -- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb60c150f90 msgr2=0x7fb60c15ba30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb60c150f90 0x7fb60c15ba30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 -- 172.21.15.106:0/592672865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb60c0cb0d0 con 0x7fb5f8005210 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb61169c700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e560 tx=0x7fb60800e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60800c070 con 0x7fb5f8005210 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608013610 con 0x7fb5f8005210 2023-11-24T06:13:48.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb60c0cb3b0 con 0x7fb5f8005210 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6080139a0 con 0x7fb5f8005210 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.113+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb60c140380 con 0x7fb5f8005210 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.114+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb60c15b0a0 con 0x7fb5f8005210 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.115+0000 7f7fb8223700 1 -- 172.21.15.106:0/3802520604 shutdown_connections 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.115+0000 7f7fb8223700 1 -- 172.21.15.106:0/3802520604 wait complete. 2023-11-24T06:13:48.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.115+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f45f015cc90 con 0x7f45f00b2870 2023-11-24T06:13:48.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.115+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb608013b00 con 0x7fb5f8005210 2023-11-24T06:13:48.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.116+0000 7fb601ffb700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 0x7fb5f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.116+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb6080891b0 con 0x7fb5f8005210 2023-11-24T06:13:48.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.116+0000 7f7fb8223700 1 Processor -- start 2023-11-24T06:13:48.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.116+0000 7f7fb8223700 1 -- start start 2023-11-24T06:13:48.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b0f80 0x7f7fb01f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb015ee90 0x7f7fb01f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb01f9840 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00af110 con 0x7f7fb015ee90 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.117+0000 7f7fb8223700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb00cfb70 con 0x7f7fb00b0f80 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58080/0 (socket says 172.21.15.106:58080) 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/2153338240 learned_addr learned my addr 172.21.15.106:0/2153338240 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb57be700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b0f80 0x7f7fb01f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b0f80 msgr2=0x7f7fb01f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b0f80 0x7f7fb01f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb015ee90 msgr2=0x7f7fb01f23a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:48.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb015ee90 0x7f7fb01f23a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 -- 172.21.15.106:0/2153338240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac00b7f0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.118+0000 7f7fb5fbf700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00b340 tx=0x7f7fac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.120+0000 7fb610e9b700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 0x7fb5f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.120+0000 7fb610e9b700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 0x7fb5f006d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007fd0 tx=0x7fb5fc007a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.121+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f88b405fc80 con 0x7f88c4163a00 2023-11-24T06:13:48.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.124+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac003ce0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.125+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac003e40 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.125+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac010690 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.125+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fb00ae500 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.125+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb00aeac0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.125+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb608054260 con 0x7fb5f8005210 2023-11-24T06:13:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.128+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fac0193f0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.128+0000 7f7fa67fc700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 0x7f7f9c06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.128+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fac08b3c0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.129+0000 7f7fb57be700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 0x7f7f9c06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:48.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.129+0000 7f7fb57be700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 0x7f7f9c06d5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fb01f63e0 tx=0x7f7fa80094f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:48.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.126+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44780052e0 con 0x7f44940aecd0 2023-11-24T06:13:48.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.137+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f980052e0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.145+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44880542d0 con 0x7f44940aecd0 2023-11-24T06:13:48.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.154+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fac0564e0 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.505+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f8504005860 con 0x7f85240d0520 2023-11-24T06:13:48.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.501+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f45f015cc90 con 0x7f45f00b2870 2023-11-24T06:13:48.509 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.505+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f7d20005860 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.509 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.506+0000 7f45deffd700 1 -- 172.21.15.106:0/1635878106 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f45f015cc90 con 0x7f45f00b2870 2023-11-24T06:13:48.509 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2023-11-24T06:13:48.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.506+0000 7f7d38ff9700 1 -- 172.21.15.106:0/3770144750 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d3401c090 con 0x7f7d3c13f0c0 2023-11-24T06:13:48.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.507+0000 7f85217fa700 1 -- 172.21.15.106:0/2716605715 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f851c07ad70 con 0x7f85240d0520 2023-11-24T06:13:48.510 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2023-11-24T06:13:48.511 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2023-11-24T06:13:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 msgr2=0x7f7d1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 0x7f7d1c06d390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c071f00 tx=0x7f7d2c01a030 comp rx=0 tx=0).stop 2023-11-24T06:13:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 msgr2=0x7f7d3c0cde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400b780 tx=0x7f7d3400bb40 comp rx=0 tx=0).stop 2023-11-24T06:13:48.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 shutdown_connections 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7d1c06aed0 0x7f7d1c06d390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d3c0ce3a0 0x7f7d3c134390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7d3c13f0c0 0x7f7d3c0cde60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 --2- 172.21.15.106:0/3770144750 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7d3c13f4a0 0x7f7d3c133e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 >> 172.21.15.106:0/3770144750 conn(0x7f7d3c0b1660 msgr2=0x7f7d3c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 shutdown_connections 2023-11-24T06:13:48.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.511+0000 7f7d4109f700 1 -- 172.21.15.106:0/3770144750 wait complete. 2023-11-24T06:13:48.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.513+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 msgr2=0x7f45d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.513+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 0x7f45d006d390 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f45e0014040 tx=0x7f45e0008030 comp rx=0 tx=0).stop 2023-11-24T06:13:48.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.513+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 msgr2=0x7f45f01f0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.513+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b530 tx=0x7f45e400b840 comp rx=0 tx=0).stop 2023-11-24T06:13:48.516 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2023-11-24T06:13:48.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.513+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f0ae40751e0 con 0x7f0ae406d4d0 2023-11-24T06:13:48.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.514+0000 7f0ae17fa700 1 -- 172.21.15.106:0/3055844413 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0ad4019020 con 0x7f0ae406d4d0 2023-11-24T06:13:48.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 msgr2=0x7f850c06d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 0x7f850c06d570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8514009bc0 tx=0x7f8514013040 comp rx=0 tx=0).stop 2023-11-24T06:13:48.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 msgr2=0x7f85240ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 0x7f85240ccea0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f851c00ef90 tx=0x7f851c00c3a0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 shutdown_connections 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f45d006aed0 0x7f45d006d390 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f015c160 0x7f45f01f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f45f00b02e0 0x7f45f01f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 --2- 172.21.15.106:0/1635878106 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f45f00b2870 0x7f45f01f0a50 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 >> 172.21.15.106:0/1635878106 conn(0x7f45f00b57b0 msgr2=0x7f45f00ae1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 shutdown_connections 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f850c06b0b0 0x7f850c06d570 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8514009bc0 tx=0x7f8514013040 comp rx=0 tx=0).stop 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85240d0520 0x7f85240ccea0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8524071be0 0x7f85240cc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 --2- 172.21.15.106:0/2716605715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85240b3b50 0x7f85240cc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 >> 172.21.15.106:0/2716605715 conn(0x7f85240cfa30 msgr2=0x7f8524141730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 msgr2=0x7f0ad006d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 0x7f0ad006d5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0acc014040 tx=0x7f0acc008030 comp rx=0 tx=0).stop 2023-11-24T06:13:48.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 msgr2=0x7f0ae4142570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.517+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0ad400ba50 tx=0x7f0ad400bd60 comp rx=0 tx=0).stop 2023-11-24T06:13:48.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.518+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 shutdown_connections 2023-11-24T06:13:48.522 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.518+0000 7f45f4c94700 1 -- 172.21.15.106:0/1635878106 wait complete. 2023-11-24T06:13:48.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 shutdown_connections 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0ad006b130 0x7f0ad006d5f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0ae4163a80 0x7f0ae415b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ae406d4d0 0x7f0ae4142570 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 --2- 172.21.15.106:0/3055844413 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0ae40b3b50 0x7f0ae4152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 >> 172.21.15.106:0/3055844413 conn(0x7f0ae40cfa30 msgr2=0x7f0ae40b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 shutdown_connections 2023-11-24T06:13:48.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f0aeb227700 1 -- 172.21.15.106:0/3055844413 wait complete. 2023-11-24T06:13:48.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.522+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 shutdown_connections 2023-11-24T06:13:48.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.523+0000 7f852ac95700 1 -- 172.21.15.106:0/2716605715 wait complete. 2023-11-24T06:13:48.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.523+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f88c40ae050 con 0x7f88c4163a00 2023-11-24T06:13:48.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.525+0000 7f88b2ffd700 1 -- 172.21.15.106:0/1228676819 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88b40632a0 con 0x7f88c4163a00 2023-11-24T06:13:48.531 INFO:teuthology.orchestra.run.smithi106.stdout:55834574853 2023-11-24T06:13:48.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2023-11-24T06:13:48.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.525+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb60c0751e0 con 0x7fb5f8005210 2023-11-24T06:13:48.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.525+0000 7fb601ffb700 1 -- 172.21.15.106:0/592672865 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb608013db0 con 0x7fb5f8005210 2023-11-24T06:13:48.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 msgr2=0x7f88a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 0x7f88a406d390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f88bc009f10 tx=0x7f88bc0098f0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 msgr2=0x7f88c416e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 0x7f88c416e500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f88b401d000 tx=0x7f88b4004750 comp rx=0 tx=0).stop 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 shutdown_connections 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f88a406aed0 0x7f88a406d390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f88c4163a00 0x7f88c416e500 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.534 INFO:teuthology.orchestra.run.smithi106.stdout:55834574854 2023-11-24T06:13:48.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f88c40b4260 0x7f88c40adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 --2- 172.21.15.106:0/1228676819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88c416abf0 0x7f88c408a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 >> 172.21.15.106:0/1228676819 conn(0x7f88c40cfa30 msgr2=0x7f88c4072410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 shutdown_connections 2023-11-24T06:13:48.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.529+0000 7f88c8d74700 1 -- 172.21.15.106:0/1228676819 wait complete. 2023-11-24T06:13:48.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4478005860 con 0x7f44940aecd0 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 msgr2=0x7fb5f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 0x7fb5f006d390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc007fd0 tx=0x7fb5fc007a00 comp rx=0 tx=0).stop 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 msgr2=0x7fb60c15ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb60800e560 tx=0x7fb60800e870 comp rx=0 tx=0).stop 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.534+0000 7f4482ffd700 1 -- 172.21.15.106:0/3316298966 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44880578f0 con 0x7f44940aecd0 2023-11-24T06:13:48.537 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:48.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.7 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 shutdown_connections 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb5f006aed0 0x7fb5f006d390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb60c15bf70 0x7fb60c13fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f8005210 0x7fb60c15ab60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 --2- 172.21.15.106:0/592672865 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb60c150f90 0x7fb60c15ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.538+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 >> 172.21.15.106:0/592672865 conn(0x7fb60c0b5b50 msgr2=0x7fb60c153410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.540+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 shutdown_connections 2023-11-24T06:13:48.542 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.540+0000 7fb613900700 1 -- 172.21.15.106:0/592672865 wait complete. 2023-11-24T06:13:48.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 msgr2=0x7f447406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 0x7f447406d390 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4494069df0 tx=0x7f448400c040 comp rx=0 tx=0).stop 2023-11-24T06:13:48.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 msgr2=0x7f44941ff5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f448800bbd0 tx=0x7f448800bee0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 shutdown_connections 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f447406aed0 0x7f447406d390 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4494069df0 tx=0x7f448400c040 comp rx=0 tx=0).stop 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44941ffb10 0x7f4494203b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f447c0070c0 0x7f44940ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 --2- 172.21.15.106:0/3316298966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44940aecd0 0x7f44941ff5d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.541+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 >> 172.21.15.106:0/3316298966 conn(0x7f44940cfa30 msgr2=0x7f44940b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.3 2023-11-24T06:13:48.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.546+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 shutdown_connections 2023-11-24T06:13:48.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.546+0000 7f4498e32700 1 -- 172.21.15.106:0/3316298966 wait complete. 2023-11-24T06:13:48.551 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2023-11-24T06:13:48.556 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.2 2023-11-24T06:13:48.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.1 2023-11-24T06:13:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.555+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7f98005590 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.556+0000 7f7fa67fc700 1 -- 172.21.15.106:0/2153338240 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fac059b00 con 0x7f7fb00b0ba0 2023-11-24T06:13:48.559 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 msgr2=0x7f7f9c06d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 0x7f7f9c06d5f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fb01f63e0 tx=0x7f7fa80094f0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 msgr2=0x7f7fb00af5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7fac00b340 tx=0x7f7fac004750 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 shutdown_connections 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9c06b130 0x7f7f9c06d5f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fb015ee90 0x7f7fb01f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fb00b0ba0 0x7f7fb00af5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 --2- 172.21.15.106:0/2153338240 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fb00b0f80 0x7f7fb01f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:48.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 >> 172.21.15.106:0/2153338240 conn(0x7f7fb00b57b0 msgr2=0x7f7fb006d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:48.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 shutdown_connections 2023-11-24T06:13:48.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:48.558+0000 7f7fb8223700 1 -- 172.21.15.106:0/2153338240 wait complete. 2023-11-24T06:13:48.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2023-11-24T06:13:48.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.4 2023-11-24T06:13:49.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-24T06:13:49.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-24T06:13:49.545 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-24T06:13:49.552 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-24T06:13:49.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-24T06:13:49.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-24T06:13:49.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-24T06:13:49.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-24T06:13:49.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.723+0000 7f9201f19700 1 Processor -- start 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.723+0000 7f9201f19700 1 -- start start 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.724+0000 7f9201f19700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f91fc164a90 0x7f91fc06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.724+0000 7f9201f19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc06ced0 con 0x7f91fc0b3b50 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.724+0000 7f9201f19700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91fc06da70 con 0x7f91fc06d4d0 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.724+0000 7f9201f19700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91fc1634e0 con 0x7f91fc164a90 2023-11-24T06:13:49.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.725+0000 7f91fb7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f91fc0b3b50 0x7f91fc0b3f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38354/0 (socket says 172.21.15.106:38354) 2023-11-24T06:13:49.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.725+0000 7f91fb7fe700 1 -- 172.21.15.106:0/2015735131 learned_addr learned my addr 172.21.15.106:0/2015735131 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:49.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.730+0000 7f91faffd700 1 --2- 172.21.15.106:0/2015735131 >> v2:172.21.15.176:3300/0 conn(0x7f91fc164a90 0x7f91fc06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.730+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252134843 0 0) 0x7f91fc06ced0 con 0x7f91fc0b3b50 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.730+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91e40035b0 con 0x7f91fc0b3b50 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3364175828 0 0) 0x7f91e40035b0 con 0x7f91fc0b3b50 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 >> v2:172.21.15.176:3300/0 conn(0x7f91fc164a90 msgr2=0x7f91fc06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 --2- 172.21.15.106:0/2015735131 >> v2:172.21.15.176:3300/0 conn(0x7f91fc164a90 0x7f91fc06eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 >> v1:172.21.15.176:6789/0 conn(0x7f91fc06d4d0 legacy=0x7f91fc16bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc1637c0 con 0x7f91fc0b3b50 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f91ec001670 con 0x7f91fc0b3b50 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 >> v1:172.21.15.106:6789/0 conn(0x7f91fc0b3b50 legacy=0x7f91fc0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e4003a00 0x7f91e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 0x7f91e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4005410 0x7f91e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc1634e0 con 0x7f91e4004850 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e400c2b0 con 0x7f91e4005410 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e400c470 con 0x7f91e4003a00 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.731+0000 7f91faffd700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 0x7f91e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 -- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e4003a00 msgr2=0x7f91e4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91e4003a00 0x7f91e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 -- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4005410 msgr2=0x7f91e400ba10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-24T06:13:49.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91e4005410 0x7f91e400ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 -- 172.21.15.106:0/2015735131 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc1637c0 con 0x7f91e4004850 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91faffd700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 0x7f91e4004cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91fc164f20 tx=0x7f91e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7efb13332f90b31 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f0004230 con 0x7f91e4004850 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f0004390 con 0x7f91e4004850 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91fa7fc700 1 -- 172.21.15.106:0/2015735131 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f00036a0 con 0x7f91e4004850 2023-11-24T06:13:49.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.732+0000 7f91fbfff700 1 -- 172.21.15.106:0/2015735131 reap_dead start 2023-11-24T06:13:49.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.733+0000 7f9201f19700 1 -- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 msgr2=0x7f91e4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.733+0000 7f9201f19700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 0x7f91e4004cd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91fc164f20 tx=0x7f91e4005880 comp rx=0 tx=0).stop 2023-11-24T06:13:49.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.734+0000 7f9201f19700 1 -- 172.21.15.106:0/2015735131 shutdown_connections 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.734+0000 7f9201f19700 1 --2- 172.21.15.106:0/2015735131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91e4004850 0x7f91e4004cd0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91fc164f20 tx=0x7f91e4005880 comp rx=0 tx=0).stop 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.734+0000 7f9201f19700 1 -- 172.21.15.106:0/2015735131 >> 172.21.15.106:0/2015735131 conn(0x7f91fc0cfa30 msgr2=0x7f91fc0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.734+0000 7f9201f19700 1 -- 172.21.15.106:0/2015735131 shutdown_connections 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.734+0000 7f9201f19700 1 -- 172.21.15.106:0/2015735131 wait complete. 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.736+0000 7f9201f19700 1 Processor -- start 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.736+0000 7f9201f19700 1 -- start start 2023-11-24T06:13:49.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc155960 0x7f91fc14ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc147ad0 0x7f91fc1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc147900 con 0x7f91fc14ce10 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc14d660 con 0x7f91fc147ad0 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.737+0000 7f9201f19700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91fc14d380 con 0x7f91fc155960 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.738+0000 7f91faffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.738+0000 7f91faffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58104/0 (socket says 172.21.15.106:58104) 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.738+0000 7f91faffd700 1 -- 172.21.15.106:0/3929605722 learned_addr learned my addr 172.21.15.106:0/3929605722 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 -- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc155960 msgr2=0x7f91fc14ebd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc155960 0x7f91fc14ebd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 -- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc147ad0 msgr2=0x7f91fc1473c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc147ad0 0x7f91fc1473c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 -- 172.21.15.106:0/3929605722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91fc0cdd30 con 0x7f91fc14ce10 2023-11-24T06:13:49.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.739+0000 7f91faffd700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91f0008010 tx=0x7f91f00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.740+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f001f070 con 0x7f91fc14ce10 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.740+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f000c6d0 con 0x7f91fc14ce10 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.740+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f000ca80 con 0x7f91fc14ce10 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.740+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91fc147900 con 0x7f91fc14ce10 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.740+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91fc0ce010 con 0x7f91fc14ce10 2023-11-24T06:13:49.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.743+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91f000cbe0 con 0x7f91fc14ce10 2023-11-24T06:13:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.743+0000 7f91e3fff700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 0x7f91e4090ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.743+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91f008a5d0 con 0x7f91fc14ce10 2023-11-24T06:13:49.757 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.747+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91dc0052e0 con 0x7f91fc14ce10 2023-11-24T06:13:49.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.755+0000 7f91fb7fe700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 0x7f91e4090ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.755+0000 7f91fb7fe700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 0x7f91e4090ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0017a0 tx=0x7f91ec0015f0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.757+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91f00556f0 con 0x7f91fc14ce10 2023-11-24T06:13:49.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.790+0000 7f7fb151d700 1 Processor -- start 2023-11-24T06:13:49.793 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.790+0000 7f7fb151d700 1 -- start start 2023-11-24T06:13:49.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7fb151d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fac15d6a0 0x7f7fac0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7fb151d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0720e0 con 0x7f7fac071be0 2023-11-24T06:13:49.794 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7fb151d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac0723c0 con 0x7f7fac0b4090 2023-11-24T06:13:49.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7fb151d700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac072d60 con 0x7f7fac15d6a0 2023-11-24T06:13:49.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7faaffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fac15d6a0 0x7f7fac0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7faaffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7fac15d6a0 0x7f7fac0b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58112/0 (socket says 172.21.15.106:58112) 2023-11-24T06:13:49.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7f7faaffd700 1 -- 172.21.15.106:0/958376715 learned_addr learned my addr 172.21.15.106:0/958376715 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7faaffd700 1 -- 172.21.15.106:0/958376715 >> v1:172.21.15.176:6789/0 conn(0x7f7fac0b4090 legacy=0x7f7fac0714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7faaffd700 1 -- 172.21.15.106:0/958376715 >> v1:172.21.15.106:6789/0 conn(0x7f7fac071be0 legacy=0x7f7fac140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7faaffd700 1 -- 172.21.15.106:0/958376715 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0726a0 con 0x7f7fac15d6a0 2023-11-24T06:13:49.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7faaffd700 1 --2- 172.21.15.106:0/958376715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac15d6a0 0x7f7fac0b3b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0088f0 tx=0x7f7f9c00d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cb814a99fcc7a8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.797 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7ff8e2901700 1 Processor -- start 2023-11-24T06:13:49.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.792+0000 7ff8e2901700 1 -- start start 2023-11-24T06:13:49.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8e2901700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8dc0cf430 0x7ff8dc0714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8e2901700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc15a600 0x7ff8dc0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8e2901700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8dc0cf810 con 0x7ff8dc0b3310 2023-11-24T06:13:49.798 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8e2901700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8dc15b620 con 0x7ff8dc0cf430 2023-11-24T06:13:49.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8e2901700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc071a10 con 0x7ff8dc15a600 2023-11-24T06:13:49.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8dc0cf430 0x7ff8dc0714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8dbfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8dc0cf430 0x7ff8dc0714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58116/0 (socket says 172.21.15.106:58116) 2023-11-24T06:13:49.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8dbfff700 1 -- 172.21.15.106:0/2986254350 learned_addr learned my addr 172.21.15.106:0/2986254350 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.799 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7ff8db7fe700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc15a600 0x7ff8dc0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7fa9ffb700 1 -- 172.21.15.106:0/958376715 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c010070 con 0x7f7fac15d6a0 2023-11-24T06:13:49.800 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7fa9ffb700 1 -- 172.21.15.106:0/958376715 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c00da00 con 0x7f7fac15d6a0 2023-11-24T06:13:49.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.793+0000 7f7fa9ffb700 1 -- 172.21.15.106:0/958376715 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00dd90 con 0x7f7fac15d6a0 2023-11-24T06:13:49.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8dbfff700 1 -- 172.21.15.106:0/2986254350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc15a600 msgr2=0x7ff8dc0b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.801 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8dbfff700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc15a600 0x7ff8dc0b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8dbfff700 1 -- 172.21.15.106:0/2986254350 >> v1:172.21.15.176:6789/0 conn(0x7ff8dc0b3310 legacy=0x7ff8dc15e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8dbfff700 1 -- 172.21.15.106:0/2986254350 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc15dd90 con 0x7ff8dc0cf430 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8dbfff700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc0714d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00088f0 tx=0x7ff8d000d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfb3f6f721b203 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8daffd700 1 -- 172.21.15.106:0/2986254350 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0010070 con 0x7ff8dc0cf430 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8daffd700 1 -- 172.21.15.106:0/2986254350 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000da80 con 0x7ff8dc0cf430 2023-11-24T06:13:49.802 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7ff8daffd700 1 -- 172.21.15.106:0/2986254350 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000ddf0 con 0x7ff8dc0cf430 2023-11-24T06:13:49.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7f7fb151d700 1 -- 172.21.15.106:0/958376715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac15d6a0 msgr2=0x7f7fac0b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.794+0000 7f7fb151d700 1 --2- 172.21.15.106:0/958376715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac15d6a0 0x7f7fac0b3b50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0088f0 tx=0x7f7f9c00d330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7f7fb151d700 1 -- 172.21.15.106:0/958376715 shutdown_connections 2023-11-24T06:13:49.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7f7fb151d700 1 --2- 172.21.15.106:0/958376715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac15d6a0 0x7f7fac0b3b50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7f7fb151d700 1 -- 172.21.15.106:0/958376715 >> 172.21.15.106:0/958376715 conn(0x7f7fac0cfa30 msgr2=0x7f7fac0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7f7fb151d700 1 -- 172.21.15.106:0/958376715 shutdown_connections 2023-11-24T06:13:49.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7fc10ded1700 1 Processor -- start 2023-11-24T06:13:49.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7ff8e2901700 1 -- 172.21.15.106:0/2986254350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 msgr2=0x7ff8dc0714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7ff8e2901700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc0714d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00088f0 tx=0x7ff8d000d330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.805 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7fc10ded1700 1 -- start start 2023-11-24T06:13:49.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.796+0000 7fc10ded1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc10815d6a0 0x7fc1080b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.796+0000 7fc10ded1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc108071be0 0x7fc108140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.796+0000 7fc10ded1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1080720e0 con 0x7fc1080b4090 2023-11-24T06:13:49.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.796+0000 7fc10ded1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc108072d60 con 0x7fc108071be0 2023-11-24T06:13:49.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.796+0000 7fc10ded1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10806de80 con 0x7fc10815d6a0 2023-11-24T06:13:49.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.795+0000 7f7fb151d700 1 -- 172.21.15.106:0/958376715 wait complete. 2023-11-24T06:13:49.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7f7fb151d700 1 Processor -- start 2023-11-24T06:13:49.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc106ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc1080b4090 0x7fc1080714d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38384/0 (socket says 172.21.15.106:38384) 2023-11-24T06:13:49.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc106ffd700 1 -- 172.21.15.106:0/2358876780 learned_addr learned my addr 172.21.15.106:0/2358876780 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:49.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2358876780 >> v2:172.21.15.176:3300/0 conn(0x7fc10815d6a0 0x7fc1080b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc107fff700 1 --2- 172.21.15.106:0/2358876780 >> v2:172.21.15.106:3300/0 conn(0x7fc108071be0 0x7fc108140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7ff8e2901700 1 -- 172.21.15.106:0/2986254350 shutdown_connections 2023-11-24T06:13:49.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7ff8e2901700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc0714d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7ff8e2901700 1 --2- 172.21.15.106:0/2986254350 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc15a600 0x7ff8dc0b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7ff8e2901700 1 -- 172.21.15.106:0/2986254350 >> 172.21.15.106:0/2986254350 conn(0x7ff8dc06b1d0 msgr2=0x7ff8dc06b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 -- 172.21.15.106:0/2358876780 >> v2:172.21.15.106:3300/0 conn(0x7fc108071be0 msgr2=0x7fc108140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2358876780 >> v2:172.21.15.106:3300/0 conn(0x7fc108071be0 0x7fc108140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 -- 172.21.15.106:0/2358876780 >> v1:172.21.15.106:6789/0 conn(0x7fc1080b4090 legacy=0x7fc1080714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 -- 172.21.15.106:0/2358876780 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1080723c0 con 0x7fc10815d6a0 2023-11-24T06:13:49.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2358876780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc10815d6a0 0x7fc1080b3b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1080cfa00 tx=0x7fc10000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f0026fc0a00e921 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7f7fb151d700 1 -- start start 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 0x7f7fac1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 0x7f7fac0ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fac15d6a0 0x7f7fac1e3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac1555e0 con 0x7f7fac0b4090 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac140a10 con 0x7f7fac071be0 2023-11-24T06:13:49.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7fb151d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac155830 con 0x7f7fac15d6a0 2023-11-24T06:13:49.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7ff316693700 1 Processor -- start 2023-11-24T06:13:49.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 0x7f7fac1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7faaffd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 0x7f7fac1404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38364/0 (socket says 172.21.15.106:38364) 2023-11-24T06:13:49.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7faaffd700 1 -- 172.21.15.106:0/2025760043 learned_addr learned my addr 172.21.15.106:0/2025760043 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7ff8e2901700 1 -- 172.21.15.106:0/2986254350 shutdown_connections 2023-11-24T06:13:49.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7ff8e2901700 1 -- 172.21.15.106:0/2986254350 wait complete. 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.797+0000 7f7171ea9700 1 Processor -- start 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7f7171ea9700 1 -- start start 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f716c0b3b50 0x7f716c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f716c06d4d0 0x7f716c06eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c06ced0 con 0x7f716c0b3b50 2023-11-24T06:13:49.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c06da70 con 0x7f716c06d4d0 2023-11-24T06:13:49.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f7171ea9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c0b4470 con 0x7f716c163a80 2023-11-24T06:13:49.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f716bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f716bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40352/0 (socket says 172.21.15.106:40352) 2023-11-24T06:13:49.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f716bfff700 1 -- 172.21.15.106:0/2726750774 learned_addr learned my addr 172.21.15.106:0/2726750774 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.798+0000 7ff316693700 1 -- start start 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7ff316693700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 0x7ff3100b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7ff316693700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff3100b4090 0x7ff3100714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7ff316693700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff310071e70 con 0x7ff310071a10 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7ff316693700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff310072d60 con 0x7ff3100b4090 2023-11-24T06:13:49.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7ff316693700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31006de80 con 0x7ff31015d6a0 2023-11-24T06:13:49.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.799+0000 7f716affd700 1 --2- 172.21.15.106:0/2726750774 >> v2:172.21.15.176:3300/0 conn(0x7f716c06d4d0 0x7f716c06eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7fab7fe700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fac15d6a0 0x7f7fac1e3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7fc1067fc700 1 -- 172.21.15.106:0/2358876780 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10000e070 con 0x7fc10815d6a0 2023-11-24T06:13:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7fc1067fc700 1 -- 172.21.15.106:0/2358876780 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc100003a20 con 0x7fc10815d6a0 2023-11-24T06:13:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7fc1067fc700 1 -- 172.21.15.106:0/2358876780 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100003dd0 con 0x7fc10815d6a0 2023-11-24T06:13:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 0x7ff3100b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 0x7ff3100b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40358/0 (socket says 172.21.15.106:40358) 2023-11-24T06:13:49.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30ffff700 1 -- 172.21.15.106:0/1584451829 learned_addr learned my addr 172.21.15.106:0/1584451829 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30f7fe700 1 --2- 172.21.15.106:0/1584451829 >> v2:172.21.15.176:3300/0 conn(0x7ff3100b4090 0x7ff3100714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff8e2901700 1 Processor -- start 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 -- 172.21.15.106:0/2726750774 >> v2:172.21.15.176:3300/0 conn(0x7f716c06d4d0 msgr2=0x7f716c06eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 --2- 172.21.15.106:0/2726750774 >> v2:172.21.15.176:3300/0 conn(0x7f716c06d4d0 0x7f716c06eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 -- 172.21.15.106:0/2726750774 >> v2:172.21.15.106:3300/0 conn(0x7f716c0b3b50 msgr2=0x7f716c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 --2- 172.21.15.106:0/2726750774 >> v2:172.21.15.106:3300/0 conn(0x7f716c0b3b50 0x7f716c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 -- 172.21.15.106:0/2726750774 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c1634e0 con 0x7f716c163a80 2023-11-24T06:13:49.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716bfff700 1 --2- 172.21.15.106:0/2726750774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f716c062350 tx=0x7f716400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b970a1dc3d656aa5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716a7fc700 1 -- 172.21.15.106:0/2726750774 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400e070 con 0x7f716c163a80 2023-11-24T06:13:49.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30f7fe700 1 -- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 msgr2=0x7ff3100b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30f7fe700 1 --2- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 0x7ff3100b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30f7fe700 1 -- 172.21.15.106:0/1584451829 >> v1:172.21.15.176:6789/0 conn(0x7ff310071a10 legacy=0x7ff31006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff30f7fe700 1 -- 172.21.15.106:0/1584451829 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100720e0 con 0x7ff3100b4090 2023-11-24T06:13:49.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff30f7fe700 1 --2- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3100b4090 0x7ff3100714d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff308009dc0 tx=0x7ff30800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a58129b0f1ea34 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff30effd700 1 -- 172.21.15.106:0/1584451829 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800bd50 con 0x7ff3100b4090 2023-11-24T06:13:49.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff30effd700 1 -- 172.21.15.106:0/1584451829 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308003a20 con 0x7ff3100b4090 2023-11-24T06:13:49.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff30effd700 1 -- 172.21.15.106:0/1584451829 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308003dd0 con 0x7ff3100b4090 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 0x7f7fac0ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 -- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fac15d6a0 msgr2=0x7f7fac1e3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fac15d6a0 0x7f7fac1e3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 -- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 msgr2=0x7f7fac1404d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 0x7f7fac1404d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f7faa7fc700 1 -- 172.21.15.106:0/2025760043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c0085d0 con 0x7f7fac0b4090 2023-11-24T06:13:49.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7faa7fc700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 0x7f7fac0ceea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c7c0 tx=0x7f7fa400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7ff8e2901700 1 -- start start 2023-11-24T06:13:49.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc0b3310 0x7ff8dc144020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 0x7ff8dc14ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc14b7a0 con 0x7ff8dc0cf430 2023-11-24T06:13:49.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc14c520 con 0x7ff8dc15a600 2023-11-24T06:13:49.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7ff8e2901700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8dc144950 con 0x7ff8dc0b3310 2023-11-24T06:13:49.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7fb507f76700 1 Processor -- start 2023-11-24T06:13:49.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716a7fc700 1 -- 172.21.15.106:0/2726750774 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716400b910 con 0x7f716c163a80 2023-11-24T06:13:49.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.800+0000 7f716a7fc700 1 -- 172.21.15.106:0/2726750774 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716400bcc0 con 0x7f716c163a80 2023-11-24T06:13:49.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 -- 172.21.15.106:0/2726750774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 msgr2=0x7f716c163f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 --2- 172.21.15.106:0/2726750774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f716c062350 tx=0x7f716400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 -- 172.21.15.106:0/2726750774 shutdown_connections 2023-11-24T06:13:49.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 --2- 172.21.15.106:0/2726750774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c163f10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 --2- 172.21.15.106:0/2726750774 >> v2:172.21.15.106:3300/0 conn(0x7f716c0b3b50 0x7f716c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 --2- 172.21.15.106:0/2726750774 >> v2:172.21.15.176:3300/0 conn(0x7f716c06d4d0 0x7f716c06eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7171ea9700 1 -- 172.21.15.106:0/2726750774 >> 172.21.15.106:0/2726750774 conn(0x7f716c0cfa30 msgr2=0x7f716c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7fb507f76700 1 -- start start 2023-11-24T06:13:49.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7f7171ea9700 1 -- 172.21.15.106:0/2726750774 shutdown_connections 2023-11-24T06:13:49.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58146/0 (socket says 172.21.15.106:58146) 2023-11-24T06:13:49.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 -- 172.21.15.106:0/3767626044 learned_addr learned my addr 172.21.15.106:0/3767626044 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8e0e9e700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 0x7ff8dc14ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8dbfff700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc0b3310 0x7ff8dc144020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 -- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc0b3310 msgr2=0x7ff8dc144020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc0b3310 0x7ff8dc144020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 -- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 msgr2=0x7ff8dc14ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 0x7ff8dc14ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8db7fe700 1 -- 172.21.15.106:0/3767626044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d00085d0 con 0x7ff8dc0cf430 2023-11-24T06:13:49.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7ff8e0e9e700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 0x7ff8dc14ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:49.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7fc10ded1700 1 -- 172.21.15.106:0/2358876780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc10815d6a0 msgr2=0x7fc1080b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2358876780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc10815d6a0 0x7fc1080b3b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc1080cfa00 tx=0x7fc10000b330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb507f76700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb507f76700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb50015a960 0x7fb5000b2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb507f76700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50006d360 con 0x7fb5000b3580 2023-11-24T06:13:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb507f76700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5000629b0 con 0x7fb50015a960 2023-11-24T06:13:49.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb507f76700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50015b100 con 0x7fb500158000 2023-11-24T06:13:49.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb505d12700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7fb505d12700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40370/0 (socket says 172.21.15.106:40370) 2023-11-24T06:13:49.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 -- 172.21.15.106:0/2089992824 learned_addr learned my addr 172.21.15.106:0/2089992824 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb506513700 1 --2- 172.21.15.106:0/2089992824 >> v2:172.21.15.106:3300/0 conn(0x7fb50015a960 0x7fb5000b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4003e10 con 0x7f7fac0b4090 2023-11-24T06:13:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa4005070 con 0x7f7fac0b4090 2023-11-24T06:13:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4005420 con 0x7f7fac0b4090 2023-11-24T06:13:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac155b10 con 0x7f7fac0b4090 2023-11-24T06:13:49.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.801+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1560d0 con 0x7f7fac0b4090 2023-11-24T06:13:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 -- 172.21.15.106:0/2089992824 >> v2:172.21.15.106:3300/0 conn(0x7fb50015a960 msgr2=0x7fb5000b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 --2- 172.21.15.106:0/2089992824 >> v2:172.21.15.106:3300/0 conn(0x7fb50015a960 0x7fb5000b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 -- 172.21.15.106:0/2089992824 >> v1:172.21.15.176:6789/0 conn(0x7fb5000b3580 legacy=0x7fb5000622a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:49.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 -- 172.21.15.106:0/2089992824 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50015b3e0 con 0x7fb500158000 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 -- 172.21.15.106:0/2358876780 shutdown_connections 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2358876780 >> v2:172.21.15.106:3300/0 conn(0x7fc108071be0 0x7fc108140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2358876780 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc10815d6a0 0x7fc1080b3b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 -- 172.21.15.106:0/2358876780 >> 172.21.15.106:0/2358876780 conn(0x7fc1080cfa30 msgr2=0x7fc1080cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 -- 172.21.15.106:0/2358876780 shutdown_connections 2023-11-24T06:13:49.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fc10ded1700 1 -- 172.21.15.106:0/2358876780 wait complete. 2023-11-24T06:13:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7ff316693700 1 -- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3100b4090 msgr2=0x7ff3100714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7ff316693700 1 --2- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3100b4090 0x7ff3100714d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff308009dc0 tx=0x7ff30800b330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.804+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c0052e0 con 0x7f7fac0b4090 2023-11-24T06:13:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7ff8db7fe700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00d800 tx=0x7ff8cc00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7fb505d12700 1 --2- 172.21.15.106:0/2089992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0098f0 tx=0x7fb4fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ce8745e4ebe5e1f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc0125f0 con 0x7ff8dc0cf430 2023-11-24T06:13:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8cc012750 con 0x7ff8dc0cf430 2023-11-24T06:13:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8cc012ae0 con 0x7ff8dc0cf430 2023-11-24T06:13:49.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7fc10ded1700 1 Processor -- start 2023-11-24T06:13:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8dc14ba40 con 0x7ff8dc0cf430 2023-11-24T06:13:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8dc14c000 con 0x7ff8dc0cf430 2023-11-24T06:13:49.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7fc10ded1700 1 -- start start 2023-11-24T06:13:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7fa4005580 con 0x7f7fac0b4090 2023-11-24T06:13:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f7f937fe700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 0x7f7f9806d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fa4088b30 con 0x7f7fac0b4090 2023-11-24T06:13:49.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f7faaffd700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 0x7f7f9806d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1080b4090 0x7fc10812fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc10815d6a0 0x7fc1080af820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc108158330 con 0x7fc10815d6a0 2023-11-24T06:13:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10813e950 con 0x7fc1080b4090 2023-11-24T06:13:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7fc10ded1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc108155810 con 0x7fc108071be0 2023-11-24T06:13:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40384/0 (socket says 172.21.15.106:40384) 2023-11-24T06:13:49.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7faaffd700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 0x7f7f9806d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d370 tx=0x7f7f9c00a040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 -- 172.21.15.106:0/2369676373 learned_addr learned my addr 172.21.15.106:0/2369676373 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc107fff700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc10815d6a0 0x7fc1080af820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 -- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1080b4090 msgr2=0x7fc10812fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1080b4090 0x7fc10812fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 -- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc10815d6a0 msgr2=0x7fc1080af820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc10815d6a0 0x7fc1080af820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7fc1077fe700 1 -- 172.21.15.106:0/2369676373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc100009a70 con 0x7fc108071be0 2023-11-24T06:13:49.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc1077fe700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc108072f40 tx=0x7fc100004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.802+0000 7f7171ea9700 1 -- 172.21.15.106:0/2726750774 wait complete. 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.803+0000 7f7171ea9700 1 Processor -- start 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.804+0000 7f7171ea9700 1 -- start start 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f716c06d4d0 0x7f716c0cd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716c0b3b50 0x7f716c142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15c9c0 con 0x7f716c0b3b50 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c162420 con 0x7f716c06d4d0 2023-11-24T06:13:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.805+0000 7f7171ea9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15c490 con 0x7f716c163a80 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40376/0 (socket says 172.21.15.106:40376) 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 -- 172.21.15.106:0/1120251758 learned_addr learned my addr 172.21.15.106:0/1120251758 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 -- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f716c06d4d0 msgr2=0x7f716c0cd0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f716c06d4d0 0x7f716c0cd0c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 -- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716c0b3b50 msgr2=0x7f716c142610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716c0b3b50 0x7f716c142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.806+0000 7f716bfff700 1 -- 172.21.15.106:0/1120251758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009b30 con 0x7f716c163a80 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f716bfff700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f716400b370 tx=0x7f7164004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640099b0 con 0x7f716c163a80 2023-11-24T06:13:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7164004250 con 0x7f716c163a80 2023-11-24T06:13:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640045e0 con 0x7f716c163a80 2023-11-24T06:13:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c0ccc30 con 0x7f716c163a80 2023-11-24T06:13:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.807+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c0cc5e0 con 0x7f716c163a80 2023-11-24T06:13:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100004540 con 0x7fc108071be0 2023-11-24T06:13:49.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c0492f0 con 0x7f716c163a80 2023-11-24T06:13:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7ff316693700 1 -- 172.21.15.106:0/1584451829 shutdown_connections 2023-11-24T06:13:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7ff316693700 1 --2- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff31015d6a0 0x7ff3100b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7ff316693700 1 --2- 172.21.15.106:0/1584451829 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3100b4090 0x7ff3100714d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7ff316693700 1 -- 172.21.15.106:0/1584451829 >> 172.21.15.106:0/1584451829 conn(0x7ff3100cfa30 msgr2=0x7ff3100cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.809+0000 7ff316693700 1 -- 172.21.15.106:0/1584451829 shutdown_connections 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.809+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7164004740 con 0x7f716c163a80 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.809+0000 7f7153fff700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 0x7f715406d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.809+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716408ae00 con 0x7f716c163a80 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fb504d10700 1 -- 172.21.15.106:0/2089992824 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc004230 con 0x7fb500158000 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fb504d10700 1 -- 172.21.15.106:0/2089992824 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc004390 con 0x7fb500158000 2023-11-24T06:13:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fb504d10700 1 -- 172.21.15.106:0/2089992824 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0036a0 con 0x7fb500158000 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 -- 172.21.15.106:0/2089992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 msgr2=0x7fb50015bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 --2- 172.21.15.106:0/2089992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc0098f0 tx=0x7fb4fc009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 -- 172.21.15.106:0/2089992824 shutdown_connections 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 --2- 172.21.15.106:0/2089992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb500158000 0x7fb50015bab0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 --2- 172.21.15.106:0/2089992824 >> v2:172.21.15.106:3300/0 conn(0x7fb50015a960 0x7fb5000b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 -- 172.21.15.106:0/2089992824 >> 172.21.15.106:0/2089992824 conn(0x7fb5000743b0 msgr2=0x7fb50006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1000046a0 con 0x7fc108071be0 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc100012430 con 0x7fc108071be0 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc108155ad0 con 0x7fc108071be0 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.808+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc108155db0 con 0x7fc108071be0 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.809+0000 7ff316693700 1 -- 172.21.15.106:0/1584451829 wait complete. 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7ff316693700 1 Processor -- start 2023-11-24T06:13:49.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 -- 172.21.15.106:0/2089992824 shutdown_connections 2023-11-24T06:13:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7f716b7fe700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 0x7f715406d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7fb507f76700 1 -- 172.21.15.106:0/2089992824 wait complete. 2023-11-24T06:13:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.810+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8dc068f10 con 0x7ff8dc0cf430 2023-11-24T06:13:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc108157db0 con 0x7fc108071be0 2023-11-24T06:13:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 -- start start 2023-11-24T06:13:49.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7f716b7fe700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 0x7f715406d540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f715c009690 tx=0x7f715c006bf0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7fa4053cc0 con 0x7f7fac0b4090 2023-11-24T06:13:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3100b4090 0x7ff3101ef520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff31015d6a0 0x7ff310157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101efee0 con 0x7ff31015d6a0 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101f01c0 con 0x7ff310071a10 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.811+0000 7ff316693700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3101f04a0 con 0x7ff3100b4090 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38410/0 (socket says 172.21.15.106:38410) 2023-11-24T06:13:49.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 -- 172.21.15.106:0/1908144751 learned_addr learned my addr 172.21.15.106:0/1908144751 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7fb507f76700 1 Processor -- start 2023-11-24T06:13:49.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7fb507f76700 1 -- start start 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 -- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3100b4090 msgr2=0x7ff3101ef520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3100b4090 0x7ff3101ef520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 -- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff31015d6a0 msgr2=0x7ff310157d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff31015d6a0 0x7ff310157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 -- 172.21.15.106:0/1908144751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff308009a70 con 0x7ff310071a10 2023-11-24T06:13:49.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7f5a6083c700 1 Processor -- start 2023-11-24T06:13:49.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7ff30ffff700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff30000abe0 tx=0x7ff3000080d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300010070 con 0x7ff310071a10 2023-11-24T06:13:49.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000087a0 con 0x7ff310071a10 2023-11-24T06:13:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300008b30 con 0x7ff310071a10 2023-11-24T06:13:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5000b3580 0x7fb50013ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50015a960 0x7fb50006d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb500147c80 con 0x7fb500158000 2023-11-24T06:13:49.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000cf8d0 con 0x7fb5000b3580 2023-11-24T06:13:49.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.813+0000 7fb507f76700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5000cfbb0 con 0x7fb50015a960 2023-11-24T06:13:49.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58178/0 (socket says 172.21.15.106:58178) 2023-11-24T06:13:49.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 -- 172.21.15.106:0/3929352932 learned_addr learned my addr 172.21.15.106:0/3929352932 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.812+0000 7f5a6083c700 1 -- start start 2023-11-24T06:13:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a6083c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5a5c0b9bf0 0x7f5a5c163580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a6083c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c0d3460 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a6083c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a5c0b3390 con 0x7f5a5c0d3080 2023-11-24T06:13:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a6083c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5c0b3170 con 0x7f5a5c0b9bf0 2023-11-24T06:13:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8cc012c40 con 0x7ff8dc0cf430 2023-11-24T06:13:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a59d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5a5c0b9bf0 0x7f5a5c163580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a59d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5a5c0b9bf0 0x7f5a5c163580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:38420/0 (socket says 172.21.15.106:38420) 2023-11-24T06:13:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f5a59d9b700 1 -- 172.21.15.106:0/3991460187 learned_addr learned my addr 172.21.15.106:0/3991460187 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7164055ea0 con 0x7f716c163a80 2023-11-24T06:13:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 -- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50015a960 msgr2=0x7fb50006d920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50015a960 0x7fb50006d920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 -- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5000b3580 msgr2=0x7fb50013ea00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5000b3580 0x7fb50013ea00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 -- 172.21.15.106:0/3929352932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4fc009550 con 0x7fb500158000 2023-11-24T06:13:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7fb505511700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000b550 tx=0x7fb4f000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff310151fd0 con 0x7ff310071a10 2023-11-24T06:13:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff310140750 con 0x7ff310071a10 2023-11-24T06:13:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.814+0000 7ff8d8ff9700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 0x7ff8c806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8cc08a470 con 0x7ff8dc0cf430 2023-11-24T06:13:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7f5a59d9b700 1 -- 172.21.15.106:0/3991460187 >> v1:172.21.15.176:6789/0 conn(0x7f5a5c0d3080 legacy=0x7f5a5c0b2a60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7f5a59d9b700 1 -- 172.21.15.106:0/3991460187 >> v1:172.21.15.106:6789/0 conn(0x7f5a5c0b6d20 legacy=0x7f5a5c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:49.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7f5a59d9b700 1 -- 172.21.15.106:0/3991460187 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a5c162aa0 con 0x7f5a5c0b9bf0 2023-11-24T06:13:49.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7f5a59d9b700 1 --2- 172.21.15.106:0/3991460187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c0b9bf0 0x7f5a5c163580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009e80 tx=0x7f5a5400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac8752809e5858ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3100cd5a0 con 0x7ff310071a10 2023-11-24T06:13:49.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.815+0000 7f5a5959a700 1 -- 172.21.15.106:0/3991460187 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5400e070 con 0x7f5a5c0b9bf0 2023-11-24T06:13:49.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7f5a5959a700 1 -- 172.21.15.106:0/3991460187 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54003a20 con 0x7f5a5c0b9bf0 2023-11-24T06:13:49.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7f5a5959a700 1 -- 172.21.15.106:0/3991460187 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54003dd0 con 0x7f5a5c0b9bf0 2023-11-24T06:13:49.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7ff8dbfff700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 0x7ff8c806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7ff8dbfff700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 0x7ff8c806d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d370 tx=0x7ff8d0012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7f5a6083c700 1 -- 172.21.15.106:0/3991460187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c0b9bf0 msgr2=0x7f5a5c163580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.816+0000 7f5a6083c700 1 --2- 172.21.15.106:0/3991460187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c0b9bf0 0x7f5a5c163580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009e80 tx=0x7f5a5400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7f5a6083c700 1 -- 172.21.15.106:0/3991460187 shutdown_connections 2023-11-24T06:13:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7f5a6083c700 1 --2- 172.21.15.106:0/3991460187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c0b9bf0 0x7f5a5c163580 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5a54009e80 tx=0x7f5a5400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7f5a6083c700 1 -- 172.21.15.106:0/3991460187 >> 172.21.15.106:0/3991460187 conn(0x7f5a5c0d3ed0 msgr2=0x7f5a5c0d42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff300014070 con 0x7ff310071a10 2023-11-24T06:13:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc100012590 con 0x7fc108071be0 2023-11-24T06:13:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7fc0fffff700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 0x7fc0e806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7fc106ffd700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 0x7fc0e806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc10008b930 con 0x7fc108071be0 2023-11-24T06:13:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7fc106ffd700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 0x7fc0e806d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007fd0 tx=0x7fc0f8007b40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7f5a6083c700 1 -- 172.21.15.106:0/3991460187 shutdown_connections 2023-11-24T06:13:49.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.817+0000 7ff30cff9700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 0x7ff2fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff300089120 con 0x7ff310071a10 2023-11-24T06:13:49.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7f5a6083c700 1 -- 172.21.15.106:0/3991460187 wait complete. 2023-11-24T06:13:49.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011830 con 0x7fb500158000 2023-11-24T06:13:49.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f00119b0 con 0x7fb500158000 2023-11-24T06:13:49.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f0011d60 con 0x7fb500158000 2023-11-24T06:13:49.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8cc055600 con 0x7ff8dc0cf430 2023-11-24T06:13:49.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7ff30f7fe700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 0x7ff2fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.818+0000 7ff30f7fe700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 0x7ff2fc06d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff310153ab0 tx=0x7ff308012000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.820+0000 7f5a6083c700 1 Processor -- start 2023-11-24T06:13:49.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5000cfe90 con 0x7fb500158000 2023-11-24T06:13:49.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.819+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5000cd570 con 0x7fb500158000 2023-11-24T06:13:49.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.820+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e80052e0 con 0x7fb500158000 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.820+0000 7f5a6083c700 1 -- start start 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a5c0d3080 0x7f5a5c0c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c1eb670 0x7f5a5c1602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1eac20 con 0x7f5a5c0d3080 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1eb1e0 con 0x7f5a5c1eb670 2023-11-24T06:13:49.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.821+0000 7f5a6083c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5c1ec550 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40414/0 (socket says 172.21.15.106:40414) 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 -- 172.21.15.106:0/1169035463 learned_addr learned my addr 172.21.15.106:0/1169035463 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5ad9d700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c1eb670 0x7f5a5c1602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a59d9b700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a5c0d3080 0x7f5a5c0c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 -- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c1eb670 msgr2=0x7f5a5c1602c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c1eb670 0x7f5a5c1602c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 -- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a5c0d3080 msgr2=0x7f5a5c0c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a5c0d3080 0x7f5a5c0c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:49.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 -- 172.21.15.106:0/1169035463 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a54009b30 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4f001a400 con 0x7fb500158000 2023-11-24T06:13:49.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a5a59c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00b470 tx=0x7f5a4c00b780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7fb4f67fc700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4f0089bf0 con 0x7fb500158000 2023-11-24T06:13:49.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7fb505d12700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.822+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c011830 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4c011990 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5c1ec830 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.823+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a5c160800 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.824+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c011d40 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.824+0000 7fb505d12700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009c40 tx=0x7fb4fc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:49.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.824+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5c1eca70 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.824+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc100056b50 con 0x7fc108071be0 2023-11-24T06:13:49.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.826+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3000542f0 con 0x7ff310071a10 2023-11-24T06:13:49.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.826+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a4c01a400 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.827+0000 7f5a4affd700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 0x7f5a3c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:49.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.827+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a4c089b50 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.827+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4f0054d80 con 0x7fb500158000 2023-11-24T06:13:49.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.832+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a4c089e60 con 0x7f5a5c0b6d20 2023-11-24T06:13:49.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.836+0000 7f5a59d9b700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 0x7f5a3c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:49.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:49.836+0000 7f5a59d9b700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 0x7f5a3c06d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0ba040 tx=0x7f5a54009000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.160+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f91dc005590 con 0x7f91fc14ce10 2023-11-24T06:13:50.168 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:50.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.162+0000 7f91e3fff700 1 -- 172.21.15.106:0/3929605722 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91f0028070 con 0x7f91fc14ce10 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 msgr2=0x7f91e4090ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 0x7f91e4090ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f91ec0017a0 tx=0x7f91ec0015f0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 msgr2=0x7f91fc146e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f91f0008010 tx=0x7f91f00047c0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 shutdown_connections 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f91e408eb30 0x7f91e4090ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f91fc147ad0 0x7f91fc1473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f91fc155960 0x7f91fc14ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 --2- 172.21.15.106:0/3929605722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91fc14ce10 0x7f91fc146e80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.166+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 >> 172.21.15.106:0/3929605722 conn(0x7f91fc0cfa30 msgr2=0x7f91fc070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.167+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 shutdown_connections 2023-11-24T06:13:50.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.167+0000 7f9201f19700 1 -- 172.21.15.106:0/3929605722 wait complete. 2023-11-24T06:13:50.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-11-24T06:13:50.188 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.208+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff8dc1e4610 con 0x7ff8dc0cf430 2023-11-24T06:13:50.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.208+0000 7ff8d8ff9700 1 -- 172.21.15.106:0/3767626044 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff8cc058c20 con 0x7ff8dc0cf430 2023-11-24T06:13:50.211 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 msgr2=0x7ff8c806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 0x7ff8c806d3e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff8d000d370 tx=0x7ff8d0012000 comp rx=0 tx=0).stop 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 msgr2=0x7ff8dc14c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc00d800 tx=0x7ff8cc00dbc0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 shutdown_connections 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff8c806af20 0x7ff8c806d3e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff8dc15a600 0x7ff8dc14ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff8dc0b3310 0x7ff8dc144020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 --2- 172.21.15.106:0/3767626044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8dc0cf430 0x7ff8dc14c940 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 >> 172.21.15.106:0/3767626044 conn(0x7ff8dc06b1d0 msgr2=0x7ff8dc0b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.215+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 shutdown_connections 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.216+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f714c0495a0 con 0x7f716c163a80 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.216+0000 7ff8e2901700 1 -- 172.21.15.106:0/3767626044 wait complete. 2023-11-24T06:13:50.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.216+0000 7f7153fff700 1 -- 172.21.15.106:0/1120251758 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7164020020 con 0x7f716c163a80 2023-11-24T06:13:50.220 INFO:teuthology.orchestra.run.smithi106.stdout:55834574857 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 msgr2=0x7f715406d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 0x7f715406d540 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f715c009690 tx=0x7f715c006bf0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 msgr2=0x7f716c130eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f716400b370 tx=0x7f7164004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 shutdown_connections 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f715406b080 0x7f715406d540 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f716c163a80 0x7f716c130eb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f716c06d4d0 0x7f716c0cd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 --2- 172.21.15.106:0/1120251758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f716c0b3b50 0x7f716c142610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.222+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 >> 172.21.15.106:0/1120251758 conn(0x7f716c0cfa30 msgr2=0x7f716c070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.223+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7f8c005150 con 0x7f7fac0b4090 2023-11-24T06:13:50.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.224+0000 7f7f937fe700 1 -- 172.21.15.106:0/2025760043 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7fa4017020 con 0x7f7fac0b4090 2023-11-24T06:13:50.227 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:50.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.227+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 shutdown_connections 2023-11-24T06:13:50.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.227+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 msgr2=0x7f7f9806d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.227+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 0x7f7f9806d410 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00d370 tx=0x7f7f9c00a040 comp rx=0 tx=0).stop 2023-11-24T06:13:50.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.227+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 msgr2=0x7f7fac0ceea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.227+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 0x7f7fac0ceea0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7fa400c7c0 tx=0x7f7fa400cad0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.229+0000 7f7171ea9700 1 -- 172.21.15.106:0/1120251758 wait complete. 2023-11-24T06:13:50.235 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-11-24T06:13:50.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.232+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc108157db0 con 0x7fc108071be0 2023-11-24T06:13:50.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.232+0000 7fc0fffff700 1 -- 172.21.15.106:0/2369676373 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc108157db0 con 0x7fc108071be0 2023-11-24T06:13:50.235 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.235 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:50.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 shutdown_connections 2023-11-24T06:13:50.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f9806af50 0x7f7f9806d410 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7fac15d6a0 0x7f7fac1e3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7fac071be0 0x7f7fac1404d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 --2- 172.21.15.106:0/2025760043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7fac0b4090 0x7f7fac0ceea0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 >> 172.21.15.106:0/2025760043 conn(0x7f7fac0cfa30 msgr2=0x7f7fac141b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 shutdown_connections 2023-11-24T06:13:50.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.233+0000 7f7fb151d700 1 -- 172.21.15.106:0/2025760043 wait complete. 2023-11-24T06:13:50.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb4e8005860 con 0x7fb500158000 2023-11-24T06:13:50.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fb4f67fc700 1 -- 172.21.15.106:0/3929352932 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb4f0015090 con 0x7fb500158000 2023-11-24T06:13:50.238 INFO:teuthology.orchestra.run.smithi106.stdout:55834574857 2023-11-24T06:13:50.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 msgr2=0x7fc0e806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 0x7fc0e806d3e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0f8007fd0 tx=0x7fc0f8007b40 comp rx=0 tx=0).stop 2023-11-24T06:13:50.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 msgr2=0x7fc10813e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.235+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc108072f40 tx=0x7fc100004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 shutdown_connections 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc0e806af20 0x7fc0e806d3e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc10815d6a0 0x7fc1080af820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc108071be0 0x7fc10813e090 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 --2- 172.21.15.106:0/2369676373 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc1080b4090 0x7fc10812fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 >> 172.21.15.106:0/2369676373 conn(0x7fc1080cfa30 msgr2=0x7fc108070ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 shutdown_connections 2023-11-24T06:13:50.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.237+0000 7fc10ded1700 1 -- 172.21.15.106:0/2369676373 wait complete. 2023-11-24T06:13:50.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.239+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 msgr2=0x7fb4e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.239+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc009c40 tx=0x7fb4fc008030 comp rx=0 tx=0).stop 2023-11-24T06:13:50.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.239+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 msgr2=0x7fb500147570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.239+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4f000b550 tx=0x7fb4f000b910 comp rx=0 tx=0).stop 2023-11-24T06:13:50.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.240+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7ff3101f0300 con 0x7ff310071a10 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 shutdown_connections 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50015a960 0x7fb50006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb5000b3580 0x7fb50013ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 --2- 172.21.15.106:0/3929352932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb500158000 0x7fb500147570 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 >> 172.21.15.106:0/3929352932 conn(0x7fb5000743b0 msgr2=0x7fb5001583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 shutdown_connections 2023-11-24T06:13:50.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7fb507f76700 1 -- 172.21.15.106:0/3929352932 wait complete. 2023-11-24T06:13:50.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.241+0000 7ff30cff9700 1 -- 172.21.15.106:0/1908144751 <== mon.1 v2:172.21.15.176:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff300025020 con 0x7ff310071a10 2023-11-24T06:13:50.249 INFO:teuthology.orchestra.run.smithi106.stdout:55834574855 2023-11-24T06:13:50.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.243+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5a5c067f60 con 0x7f5a5c0b6d20 2023-11-24T06:13:50.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.243+0000 7f5a4affd700 1 -- 172.21.15.106:0/1169035463 <== mon.2 v2:172.21.15.176:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a4c015090 con 0x7f5a5c0b6d20 2023-11-24T06:13:50.250 INFO:teuthology.orchestra.run.smithi106.stdout:55834574856 2023-11-24T06:13:50.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.244+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 msgr2=0x7ff2fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.244+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 0x7ff2fc06d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff310153ab0 tx=0x7ff308012000 comp rx=0 tx=0).stop 2023-11-24T06:13:50.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.244+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 msgr2=0x7ff310140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.244+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff30000abe0 tx=0x7ff3000080d0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 shutdown_connections 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff2fc06aed0 0x7ff2fc06d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff31015d6a0 0x7ff310157d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff310071a10 0x7ff310140210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 --2- 172.21.15.106:0/1908144751 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3100b4090 0x7ff3101ef520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.245+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 >> 172.21.15.106:0/1908144751 conn(0x7ff3100cfa30 msgr2=0x7ff31015c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 msgr2=0x7f5a3c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 0x7f5a3c06d3e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5a5c0ba040 tx=0x7f5a54009000 comp rx=0 tx=0).stop 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 msgr2=0x7f5a5c1ebe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c00b470 tx=0x7f5a4c00b780 comp rx=0 tx=0).stop 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 shutdown_connections 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5a3c06af20 0x7f5a3c06d3e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5a5c1eb670 0x7f5a5c1602c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5a5c0b6d20 0x7f5a5c1ebe50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 --2- 172.21.15.106:0/1169035463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5a5c0d3080 0x7f5a5c0c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 >> 172.21.15.106:0/1169035463 conn(0x7f5a5c0d3ed0 msgr2=0x7f5a5c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 shutdown_connections 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.246+0000 7f5a6083c700 1 -- 172.21.15.106:0/1169035463 wait complete. 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.247+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 shutdown_connections 2023-11-24T06:13:50.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.247+0000 7ff316693700 1 -- 172.21.15.106:0/1908144751 wait complete. 2023-11-24T06:13:50.254 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.4 2023-11-24T06:13:50.254 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-11-24T06:13:50.256 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-11-24T06:13:50.261 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-11-24T06:13:50.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-11-24T06:13:50.267 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.267 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.3 2023-11-24T06:13:50.270 DEBUG:teuthology.parallel:result is None 2023-11-24T06:13:50.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:13:50.271 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:50.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.425+0000 7fa0049b4700 1 Processor -- start 2023-11-24T06:13:50.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.425+0000 7fa0049b4700 1 -- start start 2023-11-24T06:13:50.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.426+0000 7fa0049b4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa00015e080 0x7fa0000b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.426+0000 7fa0049b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa00006c710 0x7fa0000afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.426+0000 7fa0049b4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0000ae430 con 0x7fa0000af4d0 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.426+0000 7fa0049b4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0000af0b0 con 0x7fa00015e080 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.426+0000 7fa0049b4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0000b05a0 con 0x7fa00006c710 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa00015e080 0x7fa0000b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffdd9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa0000af4d0 0x7fa00006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38466/0 (socket says 172.21.15.106:38466) 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffdd9b700 1 -- 172.21.15.106:0/1712304101 learned_addr learned my addr 172.21.15.106:0/1712304101 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffed9d700 1 --2- 172.21.15.106:0/1712304101 >> v2:172.21.15.176:3300/0 conn(0x7fa00006c710 0x7fa0000afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 -- 172.21.15.106:0/1712304101 >> v2:172.21.15.176:3300/0 conn(0x7fa00006c710 msgr2=0x7fa0000afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 --2- 172.21.15.106:0/1712304101 >> v2:172.21.15.176:3300/0 conn(0x7fa00006c710 0x7fa0000afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 -- 172.21.15.106:0/1712304101 >> v1:172.21.15.106:6789/0 conn(0x7fa0000af4d0 legacy=0x7fa00006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffd59a700 1 -- 172.21.15.106:0/1712304101 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3709535363 0 0) 0x7fa0000ae430 con 0x7fa0000af4d0 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 -- 172.21.15.106:0/1712304101 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000ae710 con 0x7fa00015e080 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffe59c700 1 --2- 172.21.15.106:0/1712304101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa00015e080 0x7fa0000b5050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa00006e060 tx=0x7f9ff4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9242c48d71e39af9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffd59a700 1 -- 172.21.15.106:0/1712304101 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4011830 con 0x7fa00015e080 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffd59a700 1 -- 172.21.15.106:0/1712304101 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff4011990 con 0x7fa00015e080 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.427+0000 7f9ffd59a700 1 -- 172.21.15.106:0/1712304101 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4011d20 con 0x7fa00015e080 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 -- 172.21.15.106:0/1712304101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa00015e080 msgr2=0x7fa0000b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1712304101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa00015e080 0x7fa0000b5050 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa00006e060 tx=0x7f9ff4009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 -- 172.21.15.106:0/1712304101 shutdown_connections 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1712304101 >> v2:172.21.15.176:3300/0 conn(0x7fa00006c710 0x7fa0000afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1712304101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa00015e080 0x7fa0000b5050 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 -- 172.21.15.106:0/1712304101 >> 172.21.15.106:0/1712304101 conn(0x7fa000071b90 msgr2=0x7fa000071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 -- 172.21.15.106:0/1712304101 shutdown_connections 2023-11-24T06:13:50.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.428+0000 7fa0049b4700 1 -- 172.21.15.106:0/1712304101 wait complete. 2023-11-24T06:13:50.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.429+0000 7fa0049b4700 1 Processor -- start 2023-11-24T06:13:50.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.429+0000 7fa0049b4700 1 -- start start 2023-11-24T06:13:50.435 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa00006c710 0x7fa0001f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa00015e080 0x7fa000154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00014b090 con 0x7fa0000af4d0 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa000154ea0 con 0x7fa00015e080 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa000155180 con 0x7fa00006c710 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58212/0 (socket says 172.21.15.106:58212) 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 -- 172.21.15.106:0/1380283234 learned_addr learned my addr 172.21.15.106:0/1380283234 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffe59c700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa00006c710 0x7fa0001f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffed9d700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa00015e080 0x7fa000154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 -- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa00006c710 msgr2=0x7fa0001f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa00006c710 0x7fa0001f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 -- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa00015e080 msgr2=0x7fa000154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa00015e080 0x7fa000154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 -- 172.21.15.106:0/1380283234 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40094a0 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9ffdd9b700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c540 tx=0x7f9ff000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0004c80 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ff0004de0 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa000155460 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff0007310 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.430+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa000154b90 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.431+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0000753f0 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.432+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ff0007470 con 0x7fa0000af4d0 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.432+0000 7f9feeffd700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 0x7f9fe006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.432+0000 7f9ffe59c700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 0x7f9fe006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.433+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ff0089370 con 0x7fa0000af4d0 2023-11-24T06:13:50.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.433+0000 7f9ffe59c700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 0x7f9fe006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40097c0 tx=0x7f9ff401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.437+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ff0054410 con 0x7fa0000af4d0 2023-11-24T06:13:50.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.621+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa0000aecd0 con 0x7f9fe006aed0 2023-11-24T06:13:50.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.628+0000 7f9feeffd700 1 -- 172.21.15.106:0/1380283234 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264604 (secure 0 0 0) 0x7f9ff4011b00 con 0x7f9fe006aed0 2023-11-24T06:13:50.634 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 msgr2=0x7f9fe006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 0x7f9fe006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff40097c0 tx=0x7f9ff401c040 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 msgr2=0x7fa000160a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ff000c540 tx=0x7f9ff000c900 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 shutdown_connections 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9fe006aed0 0x7f9fe006d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa00015e080 0x7fa000154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa00006c710 0x7fa0001f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 --2- 172.21.15.106:0/1380283234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa0000af4d0 0x7fa000160a80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 >> 172.21.15.106:0/1380283234 conn(0x7fa000071b90 msgr2=0x7fa0000b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 shutdown_connections 2023-11-24T06:13:50.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.631+0000 7fa0049b4700 1 -- 172.21.15.106:0/1380283234 wait complete. 2023-11-24T06:13:50.637 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:13:50.646 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:13:49.689992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002956"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021385+0000","last_change":"2023-11-24T06:13:41.947526+0000","last_active":"2023-11-24T06:13:43.021385+0000","last_peered":"2023-11-24T06:13:43.021385+0000","last_clean":"2023-11-24T06:13:43.021385+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:43.021385+0000","last_undegraded":"2023-11-24T06:13:43.021385+0000","last_fullsized":"2023-11-24T06:13:43.021385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:06.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931983+0000","last_change":"2023-11-24T06:13:41.934747+0000","last_active":"2023-11-24T06:13:42.931983+0000","last_peered":"2023-11-24T06:13:42.931983+0000","last_clean":"2023-11-24T06:13:42.931983+0000","last_became_active":"2023-11-24T06:13:41.933914+0000","last_became_peered":"2023-11-24T06:13:41.933914+0000","last_unstale":"2023-11-24T06:13:42.931983+0000","last_undegraded":"2023-11-24T06:13:42.931983+0000","last_fullsized":"2023-11-24T06:13:42.931983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020674+0000","last_change":"2023-11-24T06:13:41.939402+0000","last_active":"2023-11-24T06:13:43.020674+0000","last_peered":"2023-11-24T06:13:43.020674+0000","last_clean":"2023-11-24T06:13:43.020674+0000","last_became_active":"2023-11-24T06:13:41.939116+0000","last_became_peered":"2023-11-24T06:13:41.939116+0000","last_unstale":"2023-11-24T06:13:43.020674+0000","last_undegraded":"2023-11-24T06:13:43.020674+0000","last_fullsized":"2023-11-24T06:13:43.020674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020884+0000","last_change":"2023-11-24T06:13:41.946934+0000","last_active":"2023-11-24T06:13:43.020884+0000","last_peered":"2023-11-24T06:13:43.020884+0000","last_clean":"2023-11-24T06:13:43.020884+0000","last_became_active":"2023-11-24T06:13:41.943823+0000","last_became_peered":"2023-11-24T06:13:41.943823+0000","last_unstale":"2023-11-24T06:13:43.020884+0000","last_undegraded":"2023-11-24T06:13:43.020884+0000","last_fullsized":"2023-11-24T06:13:43.020884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:12.260097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020747+0000","last_change":"2023-11-24T06:13:41.947399+0000","last_active":"2023-11-24T06:13:43.020747+0000","last_peered":"2023-11-24T06:13:43.020747+0000","last_clean":"2023-11-24T06:13:43.020747+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:43.020747+0000","last_undegraded":"2023-11-24T06:13:43.020747+0000","last_fullsized":"2023-11-24T06:13:43.020747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:37.198034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020457+0000","last_change":"2023-11-24T06:13:41.937172+0000","last_active":"2023-11-24T06:13:43.020457+0000","last_peered":"2023-11-24T06:13:43.020457+0000","last_clean":"2023-11-24T06:13:43.020457+0000","last_became_active":"2023-11-24T06:13:41.935849+0000","last_became_peered":"2023-11-24T06:13:41.935849+0000","last_unstale":"2023-11-24T06:13:43.020457+0000","last_undegraded":"2023-11-24T06:13:43.020457+0000","last_fullsized":"2023-11-24T06:13:43.020457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020541+0000","last_change":"2023-11-24T06:13:41.945826+0000","last_active":"2023-11-24T06:13:43.020541+0000","last_peered":"2023-11-24T06:13:43.020541+0000","last_clean":"2023-11-24T06:13:43.020541+0000","last_became_active":"2023-11-24T06:13:41.945194+0000","last_became_peered":"2023-11-24T06:13:41.945194+0000","last_unstale":"2023-11-24T06:13:43.020541+0000","last_undegraded":"2023-11-24T06:13:43.020541+0000","last_fullsized":"2023-11-24T06:13:43.020541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020129+0000","last_change":"2023-11-24T06:13:41.952679+0000","last_active":"2023-11-24T06:13:43.020129+0000","last_peered":"2023-11-24T06:13:43.020129+0000","last_clean":"2023-11-24T06:13:43.020129+0000","last_became_active":"2023-11-24T06:13:41.952160+0000","last_became_peered":"2023-11-24T06:13:41.952160+0000","last_unstale":"2023-11-24T06:13:43.020129+0000","last_undegraded":"2023-11-24T06:13:43.020129+0000","last_fullsized":"2023-11-24T06:13:43.020129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021247+0000","last_change":"2023-11-24T06:13:41.949930+0000","last_active":"2023-11-24T06:13:43.021247+0000","last_peered":"2023-11-24T06:13:43.021247+0000","last_clean":"2023-11-24T06:13:43.021247+0000","last_became_active":"2023-11-24T06:13:41.949654+0000","last_became_peered":"2023-11-24T06:13:41.949654+0000","last_unstale":"2023-11-24T06:13:43.021247+0000","last_undegraded":"2023-11-24T06:13:43.021247+0000","last_fullsized":"2023-11-24T06:13:43.021247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:52.390178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933390+0000","last_change":"2023-11-24T06:13:41.944967+0000","last_active":"2023-11-24T06:13:42.933390+0000","last_peered":"2023-11-24T06:13:42.933390+0000","last_clean":"2023-11-24T06:13:42.933390+0000","last_became_active":"2023-11-24T06:13:41.944686+0000","last_became_peered":"2023-11-24T06:13:41.944686+0000","last_unstale":"2023-11-24T06:13:42.933390+0000","last_undegraded":"2023-11-24T06:13:42.933390+0000","last_fullsized":"2023-11-24T06:13:42.933390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932919+0000","last_change":"2023-11-24T06:13:41.938879+0000","last_active":"2023-11-24T06:13:42.932919+0000","last_peered":"2023-11-24T06:13:42.932919+0000","last_clean":"2023-11-24T06:13:42.932919+0000","last_became_active":"2023-11-24T06:13:41.938609+0000","last_became_peered":"2023-11-24T06:13:41.938609+0000","last_unstale":"2023-11-24T06:13:42.932919+0000","last_undegraded":"2023-11-24T06:13:42.932919+0000","last_fullsized":"2023-11-24T06:13:42.932919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932866+0000","last_change":"2023-11-24T06:13:41.934572+0000","last_active":"2023-11-24T06:13:42.932866+0000","last_peered":"2023-11-24T06:13:42.932866+0000","last_clean":"2023-11-24T06:13:42.932866+0000","last_became_active":"2023-11-24T06:13:41.934367+0000","last_became_peered":"2023-11-24T06:13:41.934367+0000","last_unstale":"2023-11-24T06:13:42.932866+0000","last_undegraded":"2023-11-24T06:13:42.932866+0000","last_fullsized":"2023-11-24T06:13:42.932866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020135+0000","last_change":"2023-11-24T06:13:41.950738+0000","last_active":"2023-11-24T06:13:43.020135+0000","last_peered":"2023-11-24T06:13:43.020135+0000","last_clean":"2023-11-24T06:13:43.020135+0000","last_became_active":"2023-11-24T06:13:41.950177+0000","last_became_peered":"2023-11-24T06:13:41.950177+0000","last_unstale":"2023-11-24T06:13:43.020135+0000","last_undegraded":"2023-11-24T06:13:43.020135+0000","last_fullsized":"2023-11-24T06:13:43.020135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021041+0000","last_change":"2023-11-24T06:13:41.934953+0000","last_active":"2023-11-24T06:13:43.021041+0000","last_peered":"2023-11-24T06:13:43.021041+0000","last_clean":"2023-11-24T06:13:43.021041+0000","last_became_active":"2023-11-24T06:13:41.934659+0000","last_became_peered":"2023-11-24T06:13:41.934659+0000","last_unstale":"2023-11-24T06:13:43.021041+0000","last_undegraded":"2023-11-24T06:13:43.021041+0000","last_fullsized":"2023-11-24T06:13:43.021041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931667+0000","last_change":"2023-11-24T06:13:41.928498+0000","last_active":"2023-11-24T06:13:42.931667+0000","last_peered":"2023-11-24T06:13:42.931667+0000","last_clean":"2023-11-24T06:13:42.931667+0000","last_became_active":"2023-11-24T06:13:41.928189+0000","last_became_peered":"2023-11-24T06:13:41.928189+0000","last_unstale":"2023-11-24T06:13:42.931667+0000","last_undegraded":"2023-11-24T06:13:42.931667+0000","last_fullsized":"2023-11-24T06:13:42.931667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020122+0000","last_change":"2023-11-24T06:13:41.940907+0000","last_active":"2023-11-24T06:13:43.020122+0000","last_peered":"2023-11-24T06:13:43.020122+0000","last_clean":"2023-11-24T06:13:43.020122+0000","last_became_active":"2023-11-24T06:13:41.937993+0000","last_became_peered":"2023-11-24T06:13:41.937993+0000","last_unstale":"2023-11-24T06:13:43.020122+0000","last_undegraded":"2023-11-24T06:13:43.020122+0000","last_fullsized":"2023-11-24T06:13:43.020122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021101+0000","last_change":"2023-11-24T06:13:41.947880+0000","last_active":"2023-11-24T06:13:43.021101+0000","last_peered":"2023-11-24T06:13:43.021101+0000","last_clean":"2023-11-24T06:13:43.021101+0000","last_became_active":"2023-11-24T06:13:41.947592+0000","last_became_peered":"2023-11-24T06:13:41.947592+0000","last_unstale":"2023-11-24T06:13:43.021101+0000","last_undegraded":"2023-11-24T06:13:43.021101+0000","last_fullsized":"2023-11-24T06:13:43.021101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:52.390178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020011+0000","last_change":"2023-11-24T06:13:41.947575+0000","last_active":"2023-11-24T06:13:43.020011+0000","last_peered":"2023-11-24T06:13:43.020011+0000","last_clean":"2023-11-24T06:13:43.020011+0000","last_became_active":"2023-11-24T06:13:41.947285+0000","last_became_peered":"2023-11-24T06:13:41.947285+0000","last_unstale":"2023-11-24T06:13:43.020011+0000","last_undegraded":"2023-11-24T06:13:43.020011+0000","last_fullsized":"2023-11-24T06:13:43.020011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020415+0000","last_change":"2023-11-24T06:13:41.948433+0000","last_active":"2023-11-24T06:13:43.020415+0000","last_peered":"2023-11-24T06:13:43.020415+0000","last_clean":"2023-11-24T06:13:43.020415+0000","last_became_active":"2023-11-24T06:13:41.947260+0000","last_became_peered":"2023-11-24T06:13:41.947260+0000","last_unstale":"2023-11-24T06:13:43.020415+0000","last_undegraded":"2023-11-24T06:13:43.020415+0000","last_fullsized":"2023-11-24T06:13:43.020415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.709628+0000","last_change":"2023-11-24T06:13:40.934891+0000","last_active":"2023-11-24T06:13:42.709628+0000","last_peered":"2023-11-24T06:13:42.709628+0000","last_clean":"2023-11-24T06:13:42.709628+0000","last_became_active":"2023-11-24T06:13:40.934571+0000","last_became_peered":"2023-11-24T06:13:40.934571+0000","last_unstale":"2023-11-24T06:13:42.709628+0000","last_undegraded":"2023-11-24T06:13:42.709628+0000","last_fullsized":"2023-11-24T06:13:42.709628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020674+0000","last_change":"2023-11-24T06:13:41.951352+0000","last_active":"2023-11-24T06:13:43.020674+0000","last_peered":"2023-11-24T06:13:43.020674+0000","last_clean":"2023-11-24T06:13:43.020674+0000","last_became_active":"2023-11-24T06:13:41.950474+0000","last_became_peered":"2023-11-24T06:13:41.950474+0000","last_unstale":"2023-11-24T06:13:43.020674+0000","last_undegraded":"2023-11-24T06:13:43.020674+0000","last_fullsized":"2023-11-24T06:13:43.020674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705407+0000","last_change":"2023-11-24T06:13:40.928009+0000","last_active":"2023-11-24T06:13:42.705407+0000","last_peered":"2023-11-24T06:13:42.705407+0000","last_clean":"2023-11-24T06:13:42.705407+0000","last_became_active":"2023-11-24T06:13:40.927708+0000","last_became_peered":"2023-11-24T06:13:40.927708+0000","last_unstale":"2023-11-24T06:13:42.705407+0000","last_undegraded":"2023-11-24T06:13:42.705407+0000","last_fullsized":"2023-11-24T06:13:42.705407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020805+0000","last_change":"2023-11-24T06:13:41.940330+0000","last_active":"2023-11-24T06:13:43.020805+0000","last_peered":"2023-11-24T06:13:43.020805+0000","last_clean":"2023-11-24T06:13:43.020805+0000","last_became_active":"2023-11-24T06:13:41.940009+0000","last_became_peered":"2023-11-24T06:13:41.940009+0000","last_unstale":"2023-11-24T06:13:43.020805+0000","last_undegraded":"2023-11-24T06:13:43.020805+0000","last_fullsized":"2023-11-24T06:13:43.020805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705316+0000","last_change":"2023-11-24T06:13:40.934975+0000","last_active":"2023-11-24T06:13:42.705316+0000","last_peered":"2023-11-24T06:13:42.705316+0000","last_clean":"2023-11-24T06:13:42.705316+0000","last_became_active":"2023-11-24T06:13:40.934687+0000","last_became_peered":"2023-11-24T06:13:40.934687+0000","last_unstale":"2023-11-24T06:13:42.705316+0000","last_undegraded":"2023-11-24T06:13:42.705316+0000","last_fullsized":"2023-11-24T06:13:42.705316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:14.621591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020542+0000","last_change":"2023-11-24T06:13:41.942453+0000","last_active":"2023-11-24T06:13:43.020542+0000","last_peered":"2023-11-24T06:13:43.020542+0000","last_clean":"2023-11-24T06:13:43.020542+0000","last_became_active":"2023-11-24T06:13:41.942179+0000","last_became_peered":"2023-11-24T06:13:41.942179+0000","last_unstale":"2023-11-24T06:13:43.020542+0000","last_undegraded":"2023-11-24T06:13:43.020542+0000","last_fullsized":"2023-11-24T06:13:43.020542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705229+0000","last_change":"2023-11-24T06:13:40.934902+0000","last_active":"2023-11-24T06:13:42.705229+0000","last_peered":"2023-11-24T06:13:42.705229+0000","last_clean":"2023-11-24T06:13:42.705229+0000","last_became_active":"2023-11-24T06:13:40.934610+0000","last_became_peered":"2023-11-24T06:13:40.934610+0000","last_unstale":"2023-11-24T06:13:42.705229+0000","last_undegraded":"2023-11-24T06:13:42.705229+0000","last_fullsized":"2023-11-24T06:13:42.705229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020822+0000","last_change":"2023-11-24T06:13:41.954577+0000","last_active":"2023-11-24T06:13:43.020822+0000","last_peered":"2023-11-24T06:13:43.020822+0000","last_clean":"2023-11-24T06:13:43.020822+0000","last_became_active":"2023-11-24T06:13:41.954291+0000","last_became_peered":"2023-11-24T06:13:41.954291+0000","last_unstale":"2023-11-24T06:13:43.020822+0000","last_undegraded":"2023-11-24T06:13:43.020822+0000","last_fullsized":"2023-11-24T06:13:43.020822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:37.198034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705327+0000","last_change":"2023-11-24T06:13:40.934796+0000","last_active":"2023-11-24T06:13:42.705327+0000","last_peered":"2023-11-24T06:13:42.705327+0000","last_clean":"2023-11-24T06:13:42.705327+0000","last_became_active":"2023-11-24T06:13:40.934484+0000","last_became_peered":"2023-11-24T06:13:40.934484+0000","last_unstale":"2023-11-24T06:13:42.705327+0000","last_undegraded":"2023-11-24T06:13:42.705327+0000","last_fullsized":"2023-11-24T06:13:42.705327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:49.659223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932278+0000","last_change":"2023-11-24T06:13:41.935058+0000","last_active":"2023-11-24T06:13:42.932278+0000","last_peered":"2023-11-24T06:13:42.932278+0000","last_clean":"2023-11-24T06:13:42.932278+0000","last_became_active":"2023-11-24T06:13:41.934769+0000","last_became_peered":"2023-11-24T06:13:41.934769+0000","last_unstale":"2023-11-24T06:13:42.932278+0000","last_undegraded":"2023-11-24T06:13:42.932278+0000","last_fullsized":"2023-11-24T06:13:42.932278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705733+0000","last_change":"2023-11-24T06:13:40.921881+0000","last_active":"2023-11-24T06:13:42.705733+0000","last_peered":"2023-11-24T06:13:42.705733+0000","last_clean":"2023-11-24T06:13:42.705733+0000","last_became_active":"2023-11-24T06:13:40.921653+0000","last_became_peered":"2023-11-24T06:13:40.921653+0000","last_unstale":"2023-11-24T06:13:42.705733+0000","last_undegraded":"2023-11-24T06:13:42.705733+0000","last_fullsized":"2023-11-24T06:13:42.705733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:42.082565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021557+0000","last_change":"2023-11-24T06:13:41.941156+0000","last_active":"2023-11-24T06:13:43.021557+0000","last_peered":"2023-11-24T06:13:43.021557+0000","last_clean":"2023-11-24T06:13:43.021557+0000","last_became_active":"2023-11-24T06:13:41.940843+0000","last_became_peered":"2023-11-24T06:13:41.940843+0000","last_unstale":"2023-11-24T06:13:43.021557+0000","last_undegraded":"2023-11-24T06:13:43.021557+0000","last_fullsized":"2023-11-24T06:13:43.021557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705275+0000","last_change":"2023-11-24T06:13:40.926211+0000","last_active":"2023-11-24T06:13:42.705275+0000","last_peered":"2023-11-24T06:13:42.705275+0000","last_clean":"2023-11-24T06:13:42.705275+0000","last_became_active":"2023-11-24T06:13:40.925909+0000","last_became_peered":"2023-11-24T06:13:40.925909+0000","last_unstale":"2023-11-24T06:13:42.705275+0000","last_undegraded":"2023-11-24T06:13:42.705275+0000","last_fullsized":"2023-11-24T06:13:42.705275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020276+0000","last_change":"2023-11-24T06:13:41.938794+0000","last_active":"2023-11-24T06:13:43.020276+0000","last_peered":"2023-11-24T06:13:43.020276+0000","last_clean":"2023-11-24T06:13:43.020276+0000","last_became_active":"2023-11-24T06:13:41.938527+0000","last_became_peered":"2023-11-24T06:13:41.938527+0000","last_unstale":"2023-11-24T06:13:43.020276+0000","last_undegraded":"2023-11-24T06:13:43.020276+0000","last_fullsized":"2023-11-24T06:13:43.020276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705956+0000","last_change":"2023-11-24T06:13:40.933121+0000","last_active":"2023-11-24T06:13:42.705956+0000","last_peered":"2023-11-24T06:13:42.705956+0000","last_clean":"2023-11-24T06:13:42.705956+0000","last_became_active":"2023-11-24T06:13:40.932862+0000","last_became_peered":"2023-11-24T06:13:40.932862+0000","last_unstale":"2023-11-24T06:13:42.705956+0000","last_undegraded":"2023-11-24T06:13:42.705956+0000","last_fullsized":"2023-11-24T06:13:42.705956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931756+0000","last_change":"2023-11-24T06:13:41.946170+0000","last_active":"2023-11-24T06:13:42.931756+0000","last_peered":"2023-11-24T06:13:42.931756+0000","last_clean":"2023-11-24T06:13:42.931756+0000","last_became_active":"2023-11-24T06:13:41.943707+0000","last_became_peered":"2023-11-24T06:13:41.943707+0000","last_unstale":"2023-11-24T06:13:42.931756+0000","last_undegraded":"2023-11-24T06:13:42.931756+0000","last_fullsized":"2023-11-24T06:13:42.931756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705836+0000","last_change":"2023-11-24T06:13:40.931003+0000","last_active":"2023-11-24T06:13:42.705836+0000","last_peered":"2023-11-24T06:13:42.705836+0000","last_clean":"2023-11-24T06:13:42.705836+0000","last_became_active":"2023-11-24T06:13:40.930726+0000","last_became_peered":"2023-11-24T06:13:40.930726+0000","last_unstale":"2023-11-24T06:13:42.705836+0000","last_undegraded":"2023-11-24T06:13:42.705836+0000","last_fullsized":"2023-11-24T06:13:42.705836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021029+0000","last_change":"2023-11-24T06:13:41.953367+0000","last_active":"2023-11-24T06:13:43.021029+0000","last_peered":"2023-11-24T06:13:43.021029+0000","last_clean":"2023-11-24T06:13:43.021029+0000","last_became_active":"2023-11-24T06:13:41.952985+0000","last_became_peered":"2023-11-24T06:13:41.952985+0000","last_unstale":"2023-11-24T06:13:43.021029+0000","last_undegraded":"2023-11-24T06:13:43.021029+0000","last_fullsized":"2023-11-24T06:13:43.021029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:32:58.913791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706125+0000","last_change":"2023-11-24T06:13:40.932963+0000","last_active":"2023-11-24T06:13:42.706125+0000","last_peered":"2023-11-24T06:13:42.706125+0000","last_clean":"2023-11-24T06:13:42.706125+0000","last_became_active":"2023-11-24T06:13:40.932634+0000","last_became_peered":"2023-11-24T06:13:40.932634+0000","last_unstale":"2023-11-24T06:13:42.706125+0000","last_undegraded":"2023-11-24T06:13:42.706125+0000","last_fullsized":"2023-11-24T06:13:42.706125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020928+0000","last_change":"2023-11-24T06:13:41.939776+0000","last_active":"2023-11-24T06:13:43.020928+0000","last_peered":"2023-11-24T06:13:43.020928+0000","last_clean":"2023-11-24T06:13:43.020928+0000","last_became_active":"2023-11-24T06:13:41.939488+0000","last_became_peered":"2023-11-24T06:13:41.939488+0000","last_unstale":"2023-11-24T06:13:43.020928+0000","last_undegraded":"2023-11-24T06:13:43.020928+0000","last_fullsized":"2023-11-24T06:13:43.020928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702963+0000","last_change":"2023-11-24T06:13:40.931993+0000","last_active":"2023-11-24T06:13:42.702963+0000","last_peered":"2023-11-24T06:13:42.702963+0000","last_clean":"2023-11-24T06:13:42.702963+0000","last_became_active":"2023-11-24T06:13:40.931611+0000","last_became_peered":"2023-11-24T06:13:40.931611+0000","last_unstale":"2023-11-24T06:13:42.702963+0000","last_undegraded":"2023-11-24T06:13:42.702963+0000","last_fullsized":"2023-11-24T06:13:42.702963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932730+0000","last_change":"2023-11-24T06:13:41.948915+0000","last_active":"2023-11-24T06:13:42.932730+0000","last_peered":"2023-11-24T06:13:42.932730+0000","last_clean":"2023-11-24T06:13:42.932730+0000","last_became_active":"2023-11-24T06:13:41.948645+0000","last_became_peered":"2023-11-24T06:13:41.948645+0000","last_unstale":"2023-11-24T06:13:42.932730+0000","last_undegraded":"2023-11-24T06:13:42.932730+0000","last_fullsized":"2023-11-24T06:13:42.932730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705748+0000","last_change":"2023-11-24T06:13:40.926099+0000","last_active":"2023-11-24T06:13:42.705748+0000","last_peered":"2023-11-24T06:13:42.705748+0000","last_clean":"2023-11-24T06:13:42.705748+0000","last_became_active":"2023-11-24T06:13:40.925868+0000","last_became_peered":"2023-11-24T06:13:40.925868+0000","last_unstale":"2023-11-24T06:13:42.705748+0000","last_undegraded":"2023-11-24T06:13:42.705748+0000","last_fullsized":"2023-11-24T06:13:42.705748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021391+0000","last_change":"2023-11-24T06:13:41.948132+0000","last_active":"2023-11-24T06:13:43.021391+0000","last_peered":"2023-11-24T06:13:43.021391+0000","last_clean":"2023-11-24T06:13:43.021391+0000","last_became_active":"2023-11-24T06:13:41.947078+0000","last_became_peered":"2023-11-24T06:13:41.947078+0000","last_unstale":"2023-11-24T06:13:43.021391+0000","last_undegraded":"2023-11-24T06:13:43.021391+0000","last_fullsized":"2023-11-24T06:13:43.021391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:10:57.304099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.709575+0000","last_change":"2023-11-24T06:13:40.929234+0000","last_active":"2023-11-24T06:13:42.709575+0000","last_peered":"2023-11-24T06:13:42.709575+0000","last_clean":"2023-11-24T06:13:42.709575+0000","last_became_active":"2023-11-24T06:13:40.929029+0000","last_became_peered":"2023-11-24T06:13:40.929029+0000","last_unstale":"2023-11-24T06:13:42.709575+0000","last_undegraded":"2023-11-24T06:13:42.709575+0000","last_fullsized":"2023-11-24T06:13:42.709575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020901+0000","last_change":"2023-11-24T06:13:41.948004+0000","last_active":"2023-11-24T06:13:43.020901+0000","last_peered":"2023-11-24T06:13:43.020901+0000","last_clean":"2023-11-24T06:13:43.020901+0000","last_became_active":"2023-11-24T06:13:41.947739+0000","last_became_peered":"2023-11-24T06:13:41.947739+0000","last_unstale":"2023-11-24T06:13:43.020901+0000","last_undegraded":"2023-11-24T06:13:43.020901+0000","last_fullsized":"2023-11-24T06:13:43.020901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706036+0000","last_change":"2023-11-24T06:13:40.930439+0000","last_active":"2023-11-24T06:13:42.706036+0000","last_peered":"2023-11-24T06:13:42.706036+0000","last_clean":"2023-11-24T06:13:42.706036+0000","last_became_active":"2023-11-24T06:13:40.930080+0000","last_became_peered":"2023-11-24T06:13:40.930080+0000","last_unstale":"2023-11-24T06:13:42.706036+0000","last_undegraded":"2023-11-24T06:13:42.706036+0000","last_fullsized":"2023-11-24T06:13:42.706036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020886+0000","last_change":"2023-11-24T06:13:41.947175+0000","last_active":"2023-11-24T06:13:43.020886+0000","last_peered":"2023-11-24T06:13:43.020886+0000","last_clean":"2023-11-24T06:13:43.020886+0000","last_became_active":"2023-11-24T06:13:41.946843+0000","last_became_peered":"2023-11-24T06:13:41.946843+0000","last_unstale":"2023-11-24T06:13:43.020886+0000","last_undegraded":"2023-11-24T06:13:43.020886+0000","last_fullsized":"2023-11-24T06:13:43.020886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:12.260097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705699+0000","last_change":"2023-11-24T06:13:40.921437+0000","last_active":"2023-11-24T06:13:42.705699+0000","last_peered":"2023-11-24T06:13:42.705699+0000","last_clean":"2023-11-24T06:13:42.705699+0000","last_became_active":"2023-11-24T06:13:40.921152+0000","last_became_peered":"2023-11-24T06:13:40.921152+0000","last_unstale":"2023-11-24T06:13:42.705699+0000","last_undegraded":"2023-11-24T06:13:42.705699+0000","last_fullsized":"2023-11-24T06:13:42.705699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932894+0000","last_change":"2023-11-24T06:13:41.936911+0000","last_active":"2023-11-24T06:13:42.932894+0000","last_peered":"2023-11-24T06:13:42.932894+0000","last_clean":"2023-11-24T06:13:42.932894+0000","last_became_active":"2023-11-24T06:13:41.936435+0000","last_became_peered":"2023-11-24T06:13:41.936435+0000","last_unstale":"2023-11-24T06:13:42.932894+0000","last_undegraded":"2023-11-24T06:13:42.932894+0000","last_fullsized":"2023-11-24T06:13:42.932894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702870+0000","last_change":"2023-11-24T06:13:40.931092+0000","last_active":"2023-11-24T06:13:42.702870+0000","last_peered":"2023-11-24T06:13:42.702870+0000","last_clean":"2023-11-24T06:13:42.702870+0000","last_became_active":"2023-11-24T06:13:40.930714+0000","last_became_peered":"2023-11-24T06:13:40.930714+0000","last_unstale":"2023-11-24T06:13:42.702870+0000","last_undegraded":"2023-11-24T06:13:42.702870+0000","last_fullsized":"2023-11-24T06:13:42.702870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020685+0000","last_change":"2023-11-24T06:13:41.946022+0000","last_active":"2023-11-24T06:13:43.020685+0000","last_peered":"2023-11-24T06:13:43.020685+0000","last_clean":"2023-11-24T06:13:43.020685+0000","last_became_active":"2023-11-24T06:13:41.945555+0000","last_became_peered":"2023-11-24T06:13:41.945555+0000","last_unstale":"2023-11-24T06:13:43.020685+0000","last_undegraded":"2023-11-24T06:13:43.020685+0000","last_fullsized":"2023-11-24T06:13:43.020685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.710687+0000","last_change":"2023-11-24T06:13:40.928444+0000","last_active":"2023-11-24T06:13:42.710687+0000","last_peered":"2023-11-24T06:13:42.710687+0000","last_clean":"2023-11-24T06:13:42.710687+0000","last_became_active":"2023-11-24T06:13:40.928116+0000","last_became_peered":"2023-11-24T06:13:40.928116+0000","last_unstale":"2023-11-24T06:13:42.710687+0000","last_undegraded":"2023-11-24T06:13:42.710687+0000","last_fullsized":"2023-11-24T06:13:42.710687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021211+0000","last_change":"2023-11-24T06:13:41.952432+0000","last_active":"2023-11-24T06:13:43.021211+0000","last_peered":"2023-11-24T06:13:43.021211+0000","last_clean":"2023-11-24T06:13:43.021211+0000","last_became_active":"2023-11-24T06:13:41.952182+0000","last_became_peered":"2023-11-24T06:13:41.952182+0000","last_unstale":"2023-11-24T06:13:43.021211+0000","last_undegraded":"2023-11-24T06:13:43.021211+0000","last_fullsized":"2023-11-24T06:13:43.021211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:32:58.913791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702924+0000","last_change":"2023-11-24T06:13:40.929215+0000","last_active":"2023-11-24T06:13:42.702924+0000","last_peered":"2023-11-24T06:13:42.702924+0000","last_clean":"2023-11-24T06:13:42.702924+0000","last_became_active":"2023-11-24T06:13:40.928931+0000","last_became_peered":"2023-11-24T06:13:40.928931+0000","last_unstale":"2023-11-24T06:13:42.702924+0000","last_undegraded":"2023-11-24T06:13:42.702924+0000","last_fullsized":"2023-11-24T06:13:42.702924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020996+0000","last_change":"2023-11-24T06:13:41.944099+0000","last_active":"2023-11-24T06:13:43.020996+0000","last_peered":"2023-11-24T06:13:43.020996+0000","last_clean":"2023-11-24T06:13:43.020996+0000","last_became_active":"2023-11-24T06:13:41.943810+0000","last_became_peered":"2023-11-24T06:13:41.943810+0000","last_unstale":"2023-11-24T06:13:43.020996+0000","last_undegraded":"2023-11-24T06:13:43.020996+0000","last_fullsized":"2023-11-24T06:13:43.020996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:02:16.555831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706026+0000","last_change":"2023-11-24T06:13:40.931296+0000","last_active":"2023-11-24T06:13:42.706026+0000","last_peered":"2023-11-24T06:13:42.706026+0000","last_clean":"2023-11-24T06:13:42.706026+0000","last_became_active":"2023-11-24T06:13:40.931008+0000","last_became_peered":"2023-11-24T06:13:40.931008+0000","last_unstale":"2023-11-24T06:13:42.706026+0000","last_undegraded":"2023-11-24T06:13:42.706026+0000","last_fullsized":"2023-11-24T06:13:42.706026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932403+0000","last_change":"2023-11-24T06:13:41.941033+0000","last_active":"2023-11-24T06:13:42.932403+0000","last_peered":"2023-11-24T06:13:42.932403+0000","last_clean":"2023-11-24T06:13:42.932403+0000","last_became_active":"2023-11-24T06:13:41.940774+0000","last_became_peered":"2023-11-24T06:13:41.940774+0000","last_unstale":"2023-11-24T06:13:42.932403+0000","last_undegraded":"2023-11-24T06:13:42.932403+0000","last_fullsized":"2023-11-24T06:13:42.932403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931646+0000","last_change":"2023-11-24T06:13:41.940234+0000","last_active":"2023-11-24T06:13:42.931646+0000","last_peered":"2023-11-24T06:13:42.931646+0000","last_clean":"2023-11-24T06:13:42.931646+0000","last_became_active":"2023-11-24T06:13:41.939983+0000","last_became_peered":"2023-11-24T06:13:41.939983+0000","last_unstale":"2023-11-24T06:13:42.931646+0000","last_undegraded":"2023-11-24T06:13:42.931646+0000","last_fullsized":"2023-11-24T06:13:42.931646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702906+0000","last_change":"2023-11-24T06:13:40.925168+0000","last_active":"2023-11-24T06:13:42.702906+0000","last_peered":"2023-11-24T06:13:42.702906+0000","last_clean":"2023-11-24T06:13:42.702906+0000","last_became_active":"2023-11-24T06:13:40.924883+0000","last_became_peered":"2023-11-24T06:13:40.924883+0000","last_unstale":"2023-11-24T06:13:42.702906+0000","last_undegraded":"2023-11-24T06:13:42.702906+0000","last_fullsized":"2023-11-24T06:13:42.702906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020408+0000","last_change":"2023-11-24T06:13:41.952514+0000","last_active":"2023-11-24T06:13:43.020408+0000","last_peered":"2023-11-24T06:13:43.020408+0000","last_clean":"2023-11-24T06:13:43.020408+0000","last_became_active":"2023-11-24T06:13:41.952318+0000","last_became_peered":"2023-11-24T06:13:41.952318+0000","last_unstale":"2023-11-24T06:13:43.020408+0000","last_undegraded":"2023-11-24T06:13:43.020408+0000","last_fullsized":"2023-11-24T06:13:43.020408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706050+0000","last_change":"2023-11-24T06:13:40.928925+0000","last_active":"2023-11-24T06:13:42.706050+0000","last_peered":"2023-11-24T06:13:42.706050+0000","last_clean":"2023-11-24T06:13:42.706050+0000","last_became_active":"2023-11-24T06:13:40.928516+0000","last_became_peered":"2023-11-24T06:13:40.928516+0000","last_unstale":"2023-11-24T06:13:42.706050+0000","last_undegraded":"2023-11-24T06:13:42.706050+0000","last_fullsized":"2023-11-24T06:13:42.706050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930933+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:13:41.930933+0000","last_peered":"2023-11-24T06:13:41.930933+0000","last_clean":"2023-11-24T06:13:41.930933+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:13:41.930933+0000","last_undegraded":"2023-11-24T06:13:41.930933+0000","last_fullsized":"2023-11-24T06:13:41.930933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020539+0000","last_change":"2023-11-24T06:13:41.941594+0000","last_active":"2023-11-24T06:13:43.020539+0000","last_peered":"2023-11-24T06:13:43.020539+0000","last_clean":"2023-11-24T06:13:43.020539+0000","last_became_active":"2023-11-24T06:13:41.940870+0000","last_became_peered":"2023-11-24T06:13:41.940870+0000","last_unstale":"2023-11-24T06:13:43.020539+0000","last_undegraded":"2023-11-24T06:13:43.020539+0000","last_fullsized":"2023-11-24T06:13:43.020539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:19.765353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705156+0000","last_change":"2023-11-24T06:13:40.936258+0000","last_active":"2023-11-24T06:13:42.705156+0000","last_peered":"2023-11-24T06:13:42.705156+0000","last_clean":"2023-11-24T06:13:42.705156+0000","last_became_active":"2023-11-24T06:13:40.936027+0000","last_became_peered":"2023-11-24T06:13:40.936027+0000","last_unstale":"2023-11-24T06:13:42.705156+0000","last_undegraded":"2023-11-24T06:13:42.705156+0000","last_fullsized":"2023-11-24T06:13:42.705156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705301+0000","last_change":"2023-11-24T06:13:40.935763+0000","last_active":"2023-11-24T06:13:42.705301+0000","last_peered":"2023-11-24T06:13:42.705301+0000","last_clean":"2023-11-24T06:13:42.705301+0000","last_became_active":"2023-11-24T06:13:40.935501+0000","last_became_peered":"2023-11-24T06:13:40.935501+0000","last_unstale":"2023-11-24T06:13:42.705301+0000","last_undegraded":"2023-11-24T06:13:42.705301+0000","last_fullsized":"2023-11-24T06:13:42.705301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931777+0000","last_change":"2023-11-24T06:13:41.939692+0000","last_active":"2023-11-24T06:13:42.931777+0000","last_peered":"2023-11-24T06:13:42.931777+0000","last_clean":"2023-11-24T06:13:42.931777+0000","last_became_active":"2023-11-24T06:13:41.939436+0000","last_became_peered":"2023-11-24T06:13:41.939436+0000","last_unstale":"2023-11-24T06:13:42.931777+0000","last_undegraded":"2023-11-24T06:13:42.931777+0000","last_fullsized":"2023-11-24T06:13:42.931777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931858+0000","last_change":"2023-11-24T06:13:40.929038+0000","last_active":"2023-11-24T06:13:42.931858+0000","last_peered":"2023-11-24T06:13:42.931858+0000","last_clean":"2023-11-24T06:13:42.931858+0000","last_became_active":"2023-11-24T06:13:40.928695+0000","last_became_peered":"2023-11-24T06:13:40.928695+0000","last_unstale":"2023-11-24T06:13:42.931858+0000","last_undegraded":"2023-11-24T06:13:42.931858+0000","last_fullsized":"2023-11-24T06:13:42.931858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021113+0000","last_change":"2023-11-24T06:13:41.951155+0000","last_active":"2023-11-24T06:13:43.021113+0000","last_peered":"2023-11-24T06:13:43.021113+0000","last_clean":"2023-11-24T06:13:43.021113+0000","last_became_active":"2023-11-24T06:13:41.950865+0000","last_became_peered":"2023-11-24T06:13:41.950865+0000","last_unstale":"2023-11-24T06:13:43.021113+0000","last_undegraded":"2023-11-24T06:13:43.021113+0000","last_fullsized":"2023-11-24T06:13:43.021113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705823+0000","last_change":"2023-11-24T06:13:40.928532+0000","last_active":"2023-11-24T06:13:42.705823+0000","last_peered":"2023-11-24T06:13:42.705823+0000","last_clean":"2023-11-24T06:13:42.705823+0000","last_became_active":"2023-11-24T06:13:40.928254+0000","last_became_peered":"2023-11-24T06:13:40.928254+0000","last_unstale":"2023-11-24T06:13:42.705823+0000","last_undegraded":"2023-11-24T06:13:42.705823+0000","last_fullsized":"2023-11-24T06:13:42.705823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020537+0000","last_change":"2023-11-24T06:13:41.938598+0000","last_active":"2023-11-24T06:13:43.020537+0000","last_peered":"2023-11-24T06:13:43.020537+0000","last_clean":"2023-11-24T06:13:43.020537+0000","last_became_active":"2023-11-24T06:13:41.938250+0000","last_became_peered":"2023-11-24T06:13:41.938250+0000","last_unstale":"2023-11-24T06:13:43.020537+0000","last_undegraded":"2023-11-24T06:13:43.020537+0000","last_fullsized":"2023-11-24T06:13:43.020537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705123+0000","last_change":"2023-11-24T06:13:40.935938+0000","last_active":"2023-11-24T06:13:42.705123+0000","last_peered":"2023-11-24T06:13:42.705123+0000","last_clean":"2023-11-24T06:13:42.705123+0000","last_became_active":"2023-11-24T06:13:40.935654+0000","last_became_peered":"2023-11-24T06:13:40.935654+0000","last_unstale":"2023-11-24T06:13:42.705123+0000","last_undegraded":"2023-11-24T06:13:42.705123+0000","last_fullsized":"2023-11-24T06:13:42.705123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932278+0000","last_change":"2023-11-24T06:13:41.943430+0000","last_active":"2023-11-24T06:13:42.932278+0000","last_peered":"2023-11-24T06:13:42.932278+0000","last_clean":"2023-11-24T06:13:42.932278+0000","last_became_active":"2023-11-24T06:13:41.940218+0000","last_became_peered":"2023-11-24T06:13:41.940218+0000","last_unstale":"2023-11-24T06:13:42.932278+0000","last_undegraded":"2023-11-24T06:13:42.932278+0000","last_fullsized":"2023-11-24T06:13:42.932278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702855+0000","last_change":"2023-11-24T06:13:40.934827+0000","last_active":"2023-11-24T06:13:42.702855+0000","last_peered":"2023-11-24T06:13:42.702855+0000","last_clean":"2023-11-24T06:13:42.702855+0000","last_became_active":"2023-11-24T06:13:40.934569+0000","last_became_peered":"2023-11-24T06:13:40.934569+0000","last_unstale":"2023-11-24T06:13:42.702855+0000","last_undegraded":"2023-11-24T06:13:42.702855+0000","last_fullsized":"2023-11-24T06:13:42.702855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020153+0000","last_change":"2023-11-24T06:13:41.952768+0000","last_active":"2023-11-24T06:13:43.020153+0000","last_peered":"2023-11-24T06:13:43.020153+0000","last_clean":"2023-11-24T06:13:43.020153+0000","last_became_active":"2023-11-24T06:13:41.952505+0000","last_became_peered":"2023-11-24T06:13:41.952505+0000","last_unstale":"2023-11-24T06:13:43.020153+0000","last_undegraded":"2023-11-24T06:13:43.020153+0000","last_fullsized":"2023-11-24T06:13:43.020153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702892+0000","last_change":"2023-11-24T06:13:40.930150+0000","last_active":"2023-11-24T06:13:42.702892+0000","last_peered":"2023-11-24T06:13:42.702892+0000","last_clean":"2023-11-24T06:13:42.702892+0000","last_became_active":"2023-11-24T06:13:40.929863+0000","last_became_peered":"2023-11-24T06:13:40.929863+0000","last_unstale":"2023-11-24T06:13:42.702892+0000","last_undegraded":"2023-11-24T06:13:42.702892+0000","last_fullsized":"2023-11-24T06:13:42.702892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020417+0000","last_change":"2023-11-24T06:13:41.951171+0000","last_active":"2023-11-24T06:13:43.020417+0000","last_peered":"2023-11-24T06:13:43.020417+0000","last_clean":"2023-11-24T06:13:43.020417+0000","last_became_active":"2023-11-24T06:13:41.950836+0000","last_became_peered":"2023-11-24T06:13:41.950836+0000","last_unstale":"2023-11-24T06:13:43.020417+0000","last_undegraded":"2023-11-24T06:13:43.020417+0000","last_fullsized":"2023-11-24T06:13:43.020417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705214+0000","last_change":"2023-11-24T06:13:40.934976+0000","last_active":"2023-11-24T06:13:42.705214+0000","last_peered":"2023-11-24T06:13:42.705214+0000","last_clean":"2023-11-24T06:13:42.705214+0000","last_became_active":"2023-11-24T06:13:40.934665+0000","last_became_peered":"2023-11-24T06:13:40.934665+0000","last_unstale":"2023-11-24T06:13:42.705214+0000","last_undegraded":"2023-11-24T06:13:42.705214+0000","last_fullsized":"2023-11-24T06:13:42.705214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933121+0000","last_change":"2023-11-24T06:13:41.938322+0000","last_active":"2023-11-24T06:13:42.933121+0000","last_peered":"2023-11-24T06:13:42.933121+0000","last_clean":"2023-11-24T06:13:42.933121+0000","last_became_active":"2023-11-24T06:13:41.938032+0000","last_became_peered":"2023-11-24T06:13:41.938032+0000","last_unstale":"2023-11-24T06:13:42.933121+0000","last_undegraded":"2023-11-24T06:13:42.933121+0000","last_fullsized":"2023-11-24T06:13:42.933121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702916+0000","last_change":"2023-11-24T06:13:40.931158+0000","last_active":"2023-11-24T06:13:42.702916+0000","last_peered":"2023-11-24T06:13:42.702916+0000","last_clean":"2023-11-24T06:13:42.702916+0000","last_became_active":"2023-11-24T06:13:40.930820+0000","last_became_peered":"2023-11-24T06:13:40.930820+0000","last_unstale":"2023-11-24T06:13:42.702916+0000","last_undegraded":"2023-11-24T06:13:42.702916+0000","last_fullsized":"2023-11-24T06:13:42.702916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021416+0000","last_change":"2023-11-24T06:13:41.949647+0000","last_active":"2023-11-24T06:13:43.021416+0000","last_peered":"2023-11-24T06:13:43.021416+0000","last_clean":"2023-11-24T06:13:43.021416+0000","last_became_active":"2023-11-24T06:13:41.949346+0000","last_became_peered":"2023-11-24T06:13:41.949346+0000","last_unstale":"2023-11-24T06:13:43.021416+0000","last_undegraded":"2023-11-24T06:13:43.021416+0000","last_fullsized":"2023-11-24T06:13:43.021416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:14:02.905166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702952+0000","last_change":"2023-11-24T06:13:40.932491+0000","last_active":"2023-11-24T06:13:42.702952+0000","last_peered":"2023-11-24T06:13:42.702952+0000","last_clean":"2023-11-24T06:13:42.702952+0000","last_became_active":"2023-11-24T06:13:40.932251+0000","last_became_peered":"2023-11-24T06:13:40.932251+0000","last_unstale":"2023-11-24T06:13:42.702952+0000","last_undegraded":"2023-11-24T06:13:42.702952+0000","last_fullsized":"2023-11-24T06:13:42.702952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020655+0000","last_change":"2023-11-24T06:13:41.947115+0000","last_active":"2023-11-24T06:13:43.020655+0000","last_peered":"2023-11-24T06:13:43.020655+0000","last_clean":"2023-11-24T06:13:43.020655+0000","last_became_active":"2023-11-24T06:13:41.944203+0000","last_became_peered":"2023-11-24T06:13:41.944203+0000","last_unstale":"2023-11-24T06:13:43.020655+0000","last_undegraded":"2023-11-24T06:13:43.020655+0000","last_fullsized":"2023-11-24T06:13:43.020655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702944+0000","last_change":"2023-11-24T06:13:40.926973+0000","last_active":"2023-11-24T06:13:42.702944+0000","last_peered":"2023-11-24T06:13:42.702944+0000","last_clean":"2023-11-24T06:13:42.702944+0000","last_became_active":"2023-11-24T06:13:40.926745+0000","last_became_peered":"2023-11-24T06:13:40.926745+0000","last_unstale":"2023-11-24T06:13:42.702944+0000","last_undegraded":"2023-11-24T06:13:42.702944+0000","last_fullsized":"2023-11-24T06:13:42.702944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:57.388385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021210+0000","last_change":"2023-11-24T06:13:41.946697+0000","last_active":"2023-11-24T06:13:43.021210+0000","last_peered":"2023-11-24T06:13:43.021210+0000","last_clean":"2023-11-24T06:13:43.021210+0000","last_became_active":"2023-11-24T06:13:41.946341+0000","last_became_peered":"2023-11-24T06:13:41.946341+0000","last_unstale":"2023-11-24T06:13:43.021210+0000","last_undegraded":"2023-11-24T06:13:43.021210+0000","last_fullsized":"2023-11-24T06:13:43.021210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:02:16.555831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932724+0000","last_change":"2023-11-24T06:13:41.936743+0000","last_active":"2023-11-24T06:13:42.932724+0000","last_peered":"2023-11-24T06:13:42.932724+0000","last_clean":"2023-11-24T06:13:42.932724+0000","last_became_active":"2023-11-24T06:13:41.936048+0000","last_became_peered":"2023-11-24T06:13:41.936048+0000","last_unstale":"2023-11-24T06:13:42.932724+0000","last_undegraded":"2023-11-24T06:13:42.932724+0000","last_fullsized":"2023-11-24T06:13:42.932724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.019940+0000","last_change":"2023-11-24T06:13:41.951555+0000","last_active":"2023-11-24T06:13:43.019940+0000","last_peered":"2023-11-24T06:13:43.019940+0000","last_clean":"2023-11-24T06:13:43.019940+0000","last_became_active":"2023-11-24T06:13:41.951290+0000","last_became_peered":"2023-11-24T06:13:41.951290+0000","last_unstale":"2023-11-24T06:13:43.019940+0000","last_undegraded":"2023-11-24T06:13:43.019940+0000","last_fullsized":"2023-11-24T06:13:43.019940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020806+0000","last_change":"2023-11-24T06:13:41.945563+0000","last_active":"2023-11-24T06:13:43.020806+0000","last_peered":"2023-11-24T06:13:43.020806+0000","last_clean":"2023-11-24T06:13:43.020806+0000","last_became_active":"2023-11-24T06:13:41.943916+0000","last_became_peered":"2023-11-24T06:13:41.943916+0000","last_unstale":"2023-11-24T06:13:43.020806+0000","last_undegraded":"2023-11-24T06:13:43.020806+0000","last_fullsized":"2023-11-24T06:13:43.020806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021437+0000","last_change":"2023-11-24T06:13:41.943045+0000","last_active":"2023-11-24T06:13:43.021437+0000","last_peered":"2023-11-24T06:13:43.021437+0000","last_clean":"2023-11-24T06:13:43.021437+0000","last_became_active":"2023-11-24T06:13:41.942182+0000","last_became_peered":"2023-11-24T06:13:41.942182+0000","last_unstale":"2023-11-24T06:13:43.021437+0000","last_undegraded":"2023-11-24T06:13:43.021437+0000","last_fullsized":"2023-11-24T06:13:43.021437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021155+0000","last_change":"2023-11-24T06:13:41.950138+0000","last_active":"2023-11-24T06:13:43.021155+0000","last_peered":"2023-11-24T06:13:43.021155+0000","last_clean":"2023-11-24T06:13:43.021155+0000","last_became_active":"2023-11-24T06:13:41.949872+0000","last_became_peered":"2023-11-24T06:13:41.949872+0000","last_unstale":"2023-11-24T06:13:43.021155+0000","last_undegraded":"2023-11-24T06:13:43.021155+0000","last_fullsized":"2023-11-24T06:13:43.021155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931823+0000","last_change":"2023-11-24T06:13:41.942213+0000","last_active":"2023-11-24T06:13:42.931823+0000","last_peered":"2023-11-24T06:13:42.931823+0000","last_clean":"2023-11-24T06:13:42.931823+0000","last_became_active":"2023-11-24T06:13:41.941946+0000","last_became_peered":"2023-11-24T06:13:41.941946+0000","last_unstale":"2023-11-24T06:13:42.931823+0000","last_undegraded":"2023-11-24T06:13:42.931823+0000","last_fullsized":"2023-11-24T06:13:42.931823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933472+0000","last_change":"2023-11-24T06:13:41.954479+0000","last_active":"2023-11-24T06:13:42.933472+0000","last_peered":"2023-11-24T06:13:42.933472+0000","last_clean":"2023-11-24T06:13:42.933472+0000","last_became_active":"2023-11-24T06:13:41.954180+0000","last_became_peered":"2023-11-24T06:13:41.954180+0000","last_unstale":"2023-11-24T06:13:42.933472+0000","last_undegraded":"2023-11-24T06:13:42.933472+0000","last_fullsized":"2023-11-24T06:13:42.933472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020983+0000","last_change":"2023-11-24T06:13:41.950255+0000","last_active":"2023-11-24T06:13:43.020983+0000","last_peered":"2023-11-24T06:13:43.020983+0000","last_clean":"2023-11-24T06:13:43.020983+0000","last_became_active":"2023-11-24T06:13:41.949950+0000","last_became_peered":"2023-11-24T06:13:41.949950+0000","last_unstale":"2023-11-24T06:13:43.020983+0000","last_undegraded":"2023-11-24T06:13:43.020983+0000","last_fullsized":"2023-11-24T06:13:43.020983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020326+0000","last_change":"2023-11-24T06:13:41.945908+0000","last_active":"2023-11-24T06:13:43.020326+0000","last_peered":"2023-11-24T06:13:43.020326+0000","last_clean":"2023-11-24T06:13:43.020326+0000","last_became_active":"2023-11-24T06:13:41.945619+0000","last_became_peered":"2023-11-24T06:13:41.945619+0000","last_unstale":"2023-11-24T06:13:43.020326+0000","last_undegraded":"2023-11-24T06:13:43.020326+0000","last_fullsized":"2023-11-24T06:13:43.020326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020526+0000","last_change":"2023-11-24T06:13:41.955593+0000","last_active":"2023-11-24T06:13:43.020526+0000","last_peered":"2023-11-24T06:13:43.020526+0000","last_clean":"2023-11-24T06:13:43.020526+0000","last_became_active":"2023-11-24T06:13:41.955287+0000","last_became_peered":"2023-11-24T06:13:41.955287+0000","last_unstale":"2023-11-24T06:13:43.020526+0000","last_undegraded":"2023-11-24T06:13:43.020526+0000","last_fullsized":"2023-11-24T06:13:43.020526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020615+0000","last_change":"2023-11-24T06:13:41.948053+0000","last_active":"2023-11-24T06:13:43.020615+0000","last_peered":"2023-11-24T06:13:43.020615+0000","last_clean":"2023-11-24T06:13:43.020615+0000","last_became_active":"2023-11-24T06:13:41.947768+0000","last_became_peered":"2023-11-24T06:13:41.947768+0000","last_unstale":"2023-11-24T06:13:43.020615+0000","last_undegraded":"2023-11-24T06:13:43.020615+0000","last_fullsized":"2023-11-24T06:13:43.020615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021358+0000","last_change":"2023-11-24T06:13:41.948146+0000","last_active":"2023-11-24T06:13:43.021358+0000","last_peered":"2023-11-24T06:13:43.021358+0000","last_clean":"2023-11-24T06:13:43.021358+0000","last_became_active":"2023-11-24T06:13:41.947853+0000","last_became_peered":"2023-11-24T06:13:41.947853+0000","last_unstale":"2023-11-24T06:13:43.021358+0000","last_undegraded":"2023-11-24T06:13:43.021358+0000","last_fullsized":"2023-11-24T06:13:43.021358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933070+0000","last_change":"2023-11-24T06:13:41.939852+0000","last_active":"2023-11-24T06:13:42.933070+0000","last_peered":"2023-11-24T06:13:42.933070+0000","last_clean":"2023-11-24T06:13:42.933070+0000","last_became_active":"2023-11-24T06:13:41.939587+0000","last_became_peered":"2023-11-24T06:13:41.939587+0000","last_unstale":"2023-11-24T06:13:42.933070+0000","last_undegraded":"2023-11-24T06:13:42.933070+0000","last_fullsized":"2023-11-24T06:13:42.933070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8530000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1459999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:50.650 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:13:50.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.803+0000 7fa97f52a700 1 Processor -- start 2023-11-24T06:13:50.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 -- start start 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa97813e000 0x7fa97815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 0x7fa9780b4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9780b4290 con 0x7fa97815efb0 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97815f430 con 0x7fa97813e000 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.804+0000 7fa97f52a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97813e570 con 0x7fa9780cff10 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa97813e000 0x7fa97815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97cac5700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa97815efb0 0x7fa9780cf800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38480/0 (socket says 172.21.15.106:38480) 2023-11-24T06:13:50.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97cac5700 1 -- 172.21.15.106:0/3939784097 learned_addr learned my addr 172.21.15.106:0/3939784097 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97dac7700 1 --2- 172.21.15.106:0/3939784097 >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 0x7fa9780b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 -- 172.21.15.106:0/3939784097 >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 msgr2=0x7fa9780b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 --2- 172.21.15.106:0/3939784097 >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 0x7fa9780b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 -- 172.21.15.106:0/3939784097 >> v1:172.21.15.106:6789/0 conn(0x7fa97815efb0 legacy=0x7fa9780cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa96ffff700 1 -- 172.21.15.106:0/3939784097 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229479215 0 0) 0x7fa9780b4290 con 0x7fa97815efb0 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 -- 172.21.15.106:0/3939784097 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780d0330 con 0x7fa97813e000 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97dac7700 1 --2- 172.21.15.106:0/3939784097 >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 0x7fa9780b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:50.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa97d2c6700 1 --2- 172.21.15.106:0/3939784097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97813e000 0x7fa97815ea70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa9780b3840 tx=0x7fa968009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760f9c241d6b4fc0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa96ffff700 1 -- 172.21.15.106:0/3939784097 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968011830 con 0x7fa97813e000 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa96ffff700 1 -- 172.21.15.106:0/3939784097 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968011990 con 0x7fa97813e000 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.805+0000 7fa96ffff700 1 -- 172.21.15.106:0/3939784097 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968011d20 con 0x7fa97813e000 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 -- 172.21.15.106:0/3939784097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97813e000 msgr2=0x7fa97815ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 --2- 172.21.15.106:0/3939784097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97813e000 0x7fa97815ea70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa9780b3840 tx=0x7fa968009b20 comp rx=0 tx=0).stop 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 -- 172.21.15.106:0/3939784097 shutdown_connections 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 --2- 172.21.15.106:0/3939784097 >> v2:172.21.15.176:3300/0 conn(0x7fa9780cff10 0x7fa9780b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 --2- 172.21.15.106:0/3939784097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97813e000 0x7fa97815ea70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 -- 172.21.15.106:0/3939784097 >> 172.21.15.106:0/3939784097 conn(0x7fa978072990 msgr2=0x7fa97806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 -- 172.21.15.106:0/3939784097 shutdown_connections 2023-11-24T06:13:50.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.806+0000 7fa97f52a700 1 -- 172.21.15.106:0/3939784097 wait complete. 2023-11-24T06:13:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.807+0000 7fa97f52a700 1 Processor -- start 2023-11-24T06:13:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.807+0000 7fa97f52a700 1 -- start start 2023-11-24T06:13:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9780cff10 0x7fa97813cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 0x7fa9781f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97813d530 con 0x7fa97815efb0 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa978158630 con 0x7fa97813e000 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97806e720 con 0x7fa9780cff10 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58228/0 (socket says 172.21.15.106:58228) 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 -- 172.21.15.106:0/1414060452 learned_addr learned my addr 172.21.15.106:0/1414060452 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97cac5700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 0x7fa9781f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97d2c6700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9780cff10 0x7fa97813cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 -- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9780cff10 msgr2=0x7fa97813cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9780cff10 0x7fa97813cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 -- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 msgr2=0x7fa9781f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:50.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 0x7fa9781f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 -- 172.21.15.106:0/1414060452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680094a0 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97cac5700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 0x7fa9781f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97dac7700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa970009fd0 tx=0x7fa97000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970003a20 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000f040 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa97806ea00 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.808+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970003de0 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.809+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa97806efc0 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.810+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa978067f60 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.810+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa970004030 con 0x7fa97815efb0 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.810+0000 7fa96dffb700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 0x7fa95c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:50.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.810+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa970089740 con 0x7fa97815efb0 2023-11-24T06:13:50.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.810+0000 7fa97d2c6700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 0x7fa95c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:50.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.811+0000 7fa97d2c6700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 0x7fa95c06d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa978144800 tx=0x7fa968008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:50.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:50.815+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa970054880 con 0x7fa97815efb0 2023-11-24T06:13:51.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.000+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa9780b3c40 con 0x7fa95c06aed0 2023-11-24T06:13:51.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.007+0000 7fa96dffb700 1 -- 172.21.15.106:0/1414060452 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264604 (secure 0 0 0) 0x7fa968011b00 con 0x7fa95c06aed0 2023-11-24T06:13:51.013 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 msgr2=0x7fa95c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 0x7fa95c06d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa978144800 tx=0x7fa968008030 comp rx=0 tx=0).stop 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 msgr2=0x7fa9781f3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa970009fd0 tx=0x7fa97000d460 comp rx=0 tx=0).stop 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 shutdown_connections 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa95c06aed0 0x7fa95c06d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.015 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa97815efb0 0x7fa9781f3120 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa9780cff10 0x7fa97813cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 --2- 172.21.15.106:0/1414060452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa97813e000 0x7fa9781f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 >> 172.21.15.106:0/1414060452 conn(0x7fa978072990 msgr2=0x7fa97815ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 shutdown_connections 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.011+0000 7fa97f52a700 1 -- 172.21.15.106:0/1414060452 wait complete. 2023-11-24T06:13:51.016 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:13:51.025 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-24T06:13:49.689992+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219040,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755680,"statfs":{"total":773094113280,"available":772869816320,"internally_reserved":0,"allocated":2891776,"data_stored":1752836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002956"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021385+0000","last_change":"2023-11-24T06:13:41.947526+0000","last_active":"2023-11-24T06:13:43.021385+0000","last_peered":"2023-11-24T06:13:43.021385+0000","last_clean":"2023-11-24T06:13:43.021385+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:43.021385+0000","last_undegraded":"2023-11-24T06:13:43.021385+0000","last_fullsized":"2023-11-24T06:13:43.021385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:42:06.030174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931983+0000","last_change":"2023-11-24T06:13:41.934747+0000","last_active":"2023-11-24T06:13:42.931983+0000","last_peered":"2023-11-24T06:13:42.931983+0000","last_clean":"2023-11-24T06:13:42.931983+0000","last_became_active":"2023-11-24T06:13:41.933914+0000","last_became_peered":"2023-11-24T06:13:41.933914+0000","last_unstale":"2023-11-24T06:13:42.931983+0000","last_undegraded":"2023-11-24T06:13:42.931983+0000","last_fullsized":"2023-11-24T06:13:42.931983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020674+0000","last_change":"2023-11-24T06:13:41.939402+0000","last_active":"2023-11-24T06:13:43.020674+0000","last_peered":"2023-11-24T06:13:43.020674+0000","last_clean":"2023-11-24T06:13:43.020674+0000","last_became_active":"2023-11-24T06:13:41.939116+0000","last_became_peered":"2023-11-24T06:13:41.939116+0000","last_unstale":"2023-11-24T06:13:43.020674+0000","last_undegraded":"2023-11-24T06:13:43.020674+0000","last_fullsized":"2023-11-24T06:13:43.020674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020884+0000","last_change":"2023-11-24T06:13:41.946934+0000","last_active":"2023-11-24T06:13:43.020884+0000","last_peered":"2023-11-24T06:13:43.020884+0000","last_clean":"2023-11-24T06:13:43.020884+0000","last_became_active":"2023-11-24T06:13:41.943823+0000","last_became_peered":"2023-11-24T06:13:41.943823+0000","last_unstale":"2023-11-24T06:13:43.020884+0000","last_undegraded":"2023-11-24T06:13:43.020884+0000","last_fullsized":"2023-11-24T06:13:43.020884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:12.260097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020747+0000","last_change":"2023-11-24T06:13:41.947399+0000","last_active":"2023-11-24T06:13:43.020747+0000","last_peered":"2023-11-24T06:13:43.020747+0000","last_clean":"2023-11-24T06:13:43.020747+0000","last_became_active":"2023-11-24T06:13:41.947051+0000","last_became_peered":"2023-11-24T06:13:41.947051+0000","last_unstale":"2023-11-24T06:13:43.020747+0000","last_undegraded":"2023-11-24T06:13:43.020747+0000","last_fullsized":"2023-11-24T06:13:43.020747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:37.198034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020457+0000","last_change":"2023-11-24T06:13:41.937172+0000","last_active":"2023-11-24T06:13:43.020457+0000","last_peered":"2023-11-24T06:13:43.020457+0000","last_clean":"2023-11-24T06:13:43.020457+0000","last_became_active":"2023-11-24T06:13:41.935849+0000","last_became_peered":"2023-11-24T06:13:41.935849+0000","last_unstale":"2023-11-24T06:13:43.020457+0000","last_undegraded":"2023-11-24T06:13:43.020457+0000","last_fullsized":"2023-11-24T06:13:43.020457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020541+0000","last_change":"2023-11-24T06:13:41.945826+0000","last_active":"2023-11-24T06:13:43.020541+0000","last_peered":"2023-11-24T06:13:43.020541+0000","last_clean":"2023-11-24T06:13:43.020541+0000","last_became_active":"2023-11-24T06:13:41.945194+0000","last_became_peered":"2023-11-24T06:13:41.945194+0000","last_unstale":"2023-11-24T06:13:43.020541+0000","last_undegraded":"2023-11-24T06:13:43.020541+0000","last_fullsized":"2023-11-24T06:13:43.020541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020129+0000","last_change":"2023-11-24T06:13:41.952679+0000","last_active":"2023-11-24T06:13:43.020129+0000","last_peered":"2023-11-24T06:13:43.020129+0000","last_clean":"2023-11-24T06:13:43.020129+0000","last_became_active":"2023-11-24T06:13:41.952160+0000","last_became_peered":"2023-11-24T06:13:41.952160+0000","last_unstale":"2023-11-24T06:13:43.020129+0000","last_undegraded":"2023-11-24T06:13:43.020129+0000","last_fullsized":"2023-11-24T06:13:43.020129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021247+0000","last_change":"2023-11-24T06:13:41.949930+0000","last_active":"2023-11-24T06:13:43.021247+0000","last_peered":"2023-11-24T06:13:43.021247+0000","last_clean":"2023-11-24T06:13:43.021247+0000","last_became_active":"2023-11-24T06:13:41.949654+0000","last_became_peered":"2023-11-24T06:13:41.949654+0000","last_unstale":"2023-11-24T06:13:43.021247+0000","last_undegraded":"2023-11-24T06:13:43.021247+0000","last_fullsized":"2023-11-24T06:13:43.021247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:52.390178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933390+0000","last_change":"2023-11-24T06:13:41.944967+0000","last_active":"2023-11-24T06:13:42.933390+0000","last_peered":"2023-11-24T06:13:42.933390+0000","last_clean":"2023-11-24T06:13:42.933390+0000","last_became_active":"2023-11-24T06:13:41.944686+0000","last_became_peered":"2023-11-24T06:13:41.944686+0000","last_unstale":"2023-11-24T06:13:42.933390+0000","last_undegraded":"2023-11-24T06:13:42.933390+0000","last_fullsized":"2023-11-24T06:13:42.933390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932919+0000","last_change":"2023-11-24T06:13:41.938879+0000","last_active":"2023-11-24T06:13:42.932919+0000","last_peered":"2023-11-24T06:13:42.932919+0000","last_clean":"2023-11-24T06:13:42.932919+0000","last_became_active":"2023-11-24T06:13:41.938609+0000","last_became_peered":"2023-11-24T06:13:41.938609+0000","last_unstale":"2023-11-24T06:13:42.932919+0000","last_undegraded":"2023-11-24T06:13:42.932919+0000","last_fullsized":"2023-11-24T06:13:42.932919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932866+0000","last_change":"2023-11-24T06:13:41.934572+0000","last_active":"2023-11-24T06:13:42.932866+0000","last_peered":"2023-11-24T06:13:42.932866+0000","last_clean":"2023-11-24T06:13:42.932866+0000","last_became_active":"2023-11-24T06:13:41.934367+0000","last_became_peered":"2023-11-24T06:13:41.934367+0000","last_unstale":"2023-11-24T06:13:42.932866+0000","last_undegraded":"2023-11-24T06:13:42.932866+0000","last_fullsized":"2023-11-24T06:13:42.932866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:18.012932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020135+0000","last_change":"2023-11-24T06:13:41.950738+0000","last_active":"2023-11-24T06:13:43.020135+0000","last_peered":"2023-11-24T06:13:43.020135+0000","last_clean":"2023-11-24T06:13:43.020135+0000","last_became_active":"2023-11-24T06:13:41.950177+0000","last_became_peered":"2023-11-24T06:13:41.950177+0000","last_unstale":"2023-11-24T06:13:43.020135+0000","last_undegraded":"2023-11-24T06:13:43.020135+0000","last_fullsized":"2023-11-24T06:13:43.020135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021041+0000","last_change":"2023-11-24T06:13:41.934953+0000","last_active":"2023-11-24T06:13:43.021041+0000","last_peered":"2023-11-24T06:13:43.021041+0000","last_clean":"2023-11-24T06:13:43.021041+0000","last_became_active":"2023-11-24T06:13:41.934659+0000","last_became_peered":"2023-11-24T06:13:41.934659+0000","last_unstale":"2023-11-24T06:13:43.021041+0000","last_undegraded":"2023-11-24T06:13:43.021041+0000","last_fullsized":"2023-11-24T06:13:43.021041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931667+0000","last_change":"2023-11-24T06:13:41.928498+0000","last_active":"2023-11-24T06:13:42.931667+0000","last_peered":"2023-11-24T06:13:42.931667+0000","last_clean":"2023-11-24T06:13:42.931667+0000","last_became_active":"2023-11-24T06:13:41.928189+0000","last_became_peered":"2023-11-24T06:13:41.928189+0000","last_unstale":"2023-11-24T06:13:42.931667+0000","last_undegraded":"2023-11-24T06:13:42.931667+0000","last_fullsized":"2023-11-24T06:13:42.931667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020122+0000","last_change":"2023-11-24T06:13:41.940907+0000","last_active":"2023-11-24T06:13:43.020122+0000","last_peered":"2023-11-24T06:13:43.020122+0000","last_clean":"2023-11-24T06:13:43.020122+0000","last_became_active":"2023-11-24T06:13:41.937993+0000","last_became_peered":"2023-11-24T06:13:41.937993+0000","last_unstale":"2023-11-24T06:13:43.020122+0000","last_undegraded":"2023-11-24T06:13:43.020122+0000","last_fullsized":"2023-11-24T06:13:43.020122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021101+0000","last_change":"2023-11-24T06:13:41.947880+0000","last_active":"2023-11-24T06:13:43.021101+0000","last_peered":"2023-11-24T06:13:43.021101+0000","last_clean":"2023-11-24T06:13:43.021101+0000","last_became_active":"2023-11-24T06:13:41.947592+0000","last_became_peered":"2023-11-24T06:13:41.947592+0000","last_unstale":"2023-11-24T06:13:43.021101+0000","last_undegraded":"2023-11-24T06:13:43.021101+0000","last_fullsized":"2023-11-24T06:13:43.021101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:56:52.390178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020011+0000","last_change":"2023-11-24T06:13:41.947575+0000","last_active":"2023-11-24T06:13:43.020011+0000","last_peered":"2023-11-24T06:13:43.020011+0000","last_clean":"2023-11-24T06:13:43.020011+0000","last_became_active":"2023-11-24T06:13:41.947285+0000","last_became_peered":"2023-11-24T06:13:41.947285+0000","last_unstale":"2023-11-24T06:13:43.020011+0000","last_undegraded":"2023-11-24T06:13:43.020011+0000","last_fullsized":"2023-11-24T06:13:43.020011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020415+0000","last_change":"2023-11-24T06:13:41.948433+0000","last_active":"2023-11-24T06:13:43.020415+0000","last_peered":"2023-11-24T06:13:43.020415+0000","last_clean":"2023-11-24T06:13:43.020415+0000","last_became_active":"2023-11-24T06:13:41.947260+0000","last_became_peered":"2023-11-24T06:13:41.947260+0000","last_unstale":"2023-11-24T06:13:43.020415+0000","last_undegraded":"2023-11-24T06:13:43.020415+0000","last_fullsized":"2023-11-24T06:13:43.020415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.709628+0000","last_change":"2023-11-24T06:13:40.934891+0000","last_active":"2023-11-24T06:13:42.709628+0000","last_peered":"2023-11-24T06:13:42.709628+0000","last_clean":"2023-11-24T06:13:42.709628+0000","last_became_active":"2023-11-24T06:13:40.934571+0000","last_became_peered":"2023-11-24T06:13:40.934571+0000","last_unstale":"2023-11-24T06:13:42.709628+0000","last_undegraded":"2023-11-24T06:13:42.709628+0000","last_fullsized":"2023-11-24T06:13:42.709628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020674+0000","last_change":"2023-11-24T06:13:41.951352+0000","last_active":"2023-11-24T06:13:43.020674+0000","last_peered":"2023-11-24T06:13:43.020674+0000","last_clean":"2023-11-24T06:13:43.020674+0000","last_became_active":"2023-11-24T06:13:41.950474+0000","last_became_peered":"2023-11-24T06:13:41.950474+0000","last_unstale":"2023-11-24T06:13:43.020674+0000","last_undegraded":"2023-11-24T06:13:43.020674+0000","last_fullsized":"2023-11-24T06:13:43.020674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705407+0000","last_change":"2023-11-24T06:13:40.928009+0000","last_active":"2023-11-24T06:13:42.705407+0000","last_peered":"2023-11-24T06:13:42.705407+0000","last_clean":"2023-11-24T06:13:42.705407+0000","last_became_active":"2023-11-24T06:13:40.927708+0000","last_became_peered":"2023-11-24T06:13:40.927708+0000","last_unstale":"2023-11-24T06:13:42.705407+0000","last_undegraded":"2023-11-24T06:13:42.705407+0000","last_fullsized":"2023-11-24T06:13:42.705407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020805+0000","last_change":"2023-11-24T06:13:41.940330+0000","last_active":"2023-11-24T06:13:43.020805+0000","last_peered":"2023-11-24T06:13:43.020805+0000","last_clean":"2023-11-24T06:13:43.020805+0000","last_became_active":"2023-11-24T06:13:41.940009+0000","last_became_peered":"2023-11-24T06:13:41.940009+0000","last_unstale":"2023-11-24T06:13:43.020805+0000","last_undegraded":"2023-11-24T06:13:43.020805+0000","last_fullsized":"2023-11-24T06:13:43.020805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705316+0000","last_change":"2023-11-24T06:13:40.934975+0000","last_active":"2023-11-24T06:13:42.705316+0000","last_peered":"2023-11-24T06:13:42.705316+0000","last_clean":"2023-11-24T06:13:42.705316+0000","last_became_active":"2023-11-24T06:13:40.934687+0000","last_became_peered":"2023-11-24T06:13:40.934687+0000","last_unstale":"2023-11-24T06:13:42.705316+0000","last_undegraded":"2023-11-24T06:13:42.705316+0000","last_fullsized":"2023-11-24T06:13:42.705316+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:14.621591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020542+0000","last_change":"2023-11-24T06:13:41.942453+0000","last_active":"2023-11-24T06:13:43.020542+0000","last_peered":"2023-11-24T06:13:43.020542+0000","last_clean":"2023-11-24T06:13:43.020542+0000","last_became_active":"2023-11-24T06:13:41.942179+0000","last_became_peered":"2023-11-24T06:13:41.942179+0000","last_unstale":"2023-11-24T06:13:43.020542+0000","last_undegraded":"2023-11-24T06:13:43.020542+0000","last_fullsized":"2023-11-24T06:13:43.020542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T18:08:12.467308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705229+0000","last_change":"2023-11-24T06:13:40.934902+0000","last_active":"2023-11-24T06:13:42.705229+0000","last_peered":"2023-11-24T06:13:42.705229+0000","last_clean":"2023-11-24T06:13:42.705229+0000","last_became_active":"2023-11-24T06:13:40.934610+0000","last_became_peered":"2023-11-24T06:13:40.934610+0000","last_unstale":"2023-11-24T06:13:42.705229+0000","last_undegraded":"2023-11-24T06:13:42.705229+0000","last_fullsized":"2023-11-24T06:13:42.705229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020822+0000","last_change":"2023-11-24T06:13:41.954577+0000","last_active":"2023-11-24T06:13:43.020822+0000","last_peered":"2023-11-24T06:13:43.020822+0000","last_clean":"2023-11-24T06:13:43.020822+0000","last_became_active":"2023-11-24T06:13:41.954291+0000","last_became_peered":"2023-11-24T06:13:41.954291+0000","last_unstale":"2023-11-24T06:13:43.020822+0000","last_undegraded":"2023-11-24T06:13:43.020822+0000","last_fullsized":"2023-11-24T06:13:43.020822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:20:37.198034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705327+0000","last_change":"2023-11-24T06:13:40.934796+0000","last_active":"2023-11-24T06:13:42.705327+0000","last_peered":"2023-11-24T06:13:42.705327+0000","last_clean":"2023-11-24T06:13:42.705327+0000","last_became_active":"2023-11-24T06:13:40.934484+0000","last_became_peered":"2023-11-24T06:13:40.934484+0000","last_unstale":"2023-11-24T06:13:42.705327+0000","last_undegraded":"2023-11-24T06:13:42.705327+0000","last_fullsized":"2023-11-24T06:13:42.705327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:49.659223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932278+0000","last_change":"2023-11-24T06:13:41.935058+0000","last_active":"2023-11-24T06:13:42.932278+0000","last_peered":"2023-11-24T06:13:42.932278+0000","last_clean":"2023-11-24T06:13:42.932278+0000","last_became_active":"2023-11-24T06:13:41.934769+0000","last_became_peered":"2023-11-24T06:13:41.934769+0000","last_unstale":"2023-11-24T06:13:42.932278+0000","last_undegraded":"2023-11-24T06:13:42.932278+0000","last_fullsized":"2023-11-24T06:13:42.932278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:58.395448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705733+0000","last_change":"2023-11-24T06:13:40.921881+0000","last_active":"2023-11-24T06:13:42.705733+0000","last_peered":"2023-11-24T06:13:42.705733+0000","last_clean":"2023-11-24T06:13:42.705733+0000","last_became_active":"2023-11-24T06:13:40.921653+0000","last_became_peered":"2023-11-24T06:13:40.921653+0000","last_unstale":"2023-11-24T06:13:42.705733+0000","last_undegraded":"2023-11-24T06:13:42.705733+0000","last_fullsized":"2023-11-24T06:13:42.705733+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:42.082565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021557+0000","last_change":"2023-11-24T06:13:41.941156+0000","last_active":"2023-11-24T06:13:43.021557+0000","last_peered":"2023-11-24T06:13:43.021557+0000","last_clean":"2023-11-24T06:13:43.021557+0000","last_became_active":"2023-11-24T06:13:41.940843+0000","last_became_peered":"2023-11-24T06:13:41.940843+0000","last_unstale":"2023-11-24T06:13:43.021557+0000","last_undegraded":"2023-11-24T06:13:43.021557+0000","last_fullsized":"2023-11-24T06:13:43.021557+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705275+0000","last_change":"2023-11-24T06:13:40.926211+0000","last_active":"2023-11-24T06:13:42.705275+0000","last_peered":"2023-11-24T06:13:42.705275+0000","last_clean":"2023-11-24T06:13:42.705275+0000","last_became_active":"2023-11-24T06:13:40.925909+0000","last_became_peered":"2023-11-24T06:13:40.925909+0000","last_unstale":"2023-11-24T06:13:42.705275+0000","last_undegraded":"2023-11-24T06:13:42.705275+0000","last_fullsized":"2023-11-24T06:13:42.705275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020276+0000","last_change":"2023-11-24T06:13:41.938794+0000","last_active":"2023-11-24T06:13:43.020276+0000","last_peered":"2023-11-24T06:13:43.020276+0000","last_clean":"2023-11-24T06:13:43.020276+0000","last_became_active":"2023-11-24T06:13:41.938527+0000","last_became_peered":"2023-11-24T06:13:41.938527+0000","last_unstale":"2023-11-24T06:13:43.020276+0000","last_undegraded":"2023-11-24T06:13:43.020276+0000","last_fullsized":"2023-11-24T06:13:43.020276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705956+0000","last_change":"2023-11-24T06:13:40.933121+0000","last_active":"2023-11-24T06:13:42.705956+0000","last_peered":"2023-11-24T06:13:42.705956+0000","last_clean":"2023-11-24T06:13:42.705956+0000","last_became_active":"2023-11-24T06:13:40.932862+0000","last_became_peered":"2023-11-24T06:13:40.932862+0000","last_unstale":"2023-11-24T06:13:42.705956+0000","last_undegraded":"2023-11-24T06:13:42.705956+0000","last_fullsized":"2023-11-24T06:13:42.705956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931756+0000","last_change":"2023-11-24T06:13:41.946170+0000","last_active":"2023-11-24T06:13:42.931756+0000","last_peered":"2023-11-24T06:13:42.931756+0000","last_clean":"2023-11-24T06:13:42.931756+0000","last_became_active":"2023-11-24T06:13:41.943707+0000","last_became_peered":"2023-11-24T06:13:41.943707+0000","last_unstale":"2023-11-24T06:13:42.931756+0000","last_undegraded":"2023-11-24T06:13:42.931756+0000","last_fullsized":"2023-11-24T06:13:42.931756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705836+0000","last_change":"2023-11-24T06:13:40.931003+0000","last_active":"2023-11-24T06:13:42.705836+0000","last_peered":"2023-11-24T06:13:42.705836+0000","last_clean":"2023-11-24T06:13:42.705836+0000","last_became_active":"2023-11-24T06:13:40.930726+0000","last_became_peered":"2023-11-24T06:13:40.930726+0000","last_unstale":"2023-11-24T06:13:42.705836+0000","last_undegraded":"2023-11-24T06:13:42.705836+0000","last_fullsized":"2023-11-24T06:13:42.705836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021029+0000","last_change":"2023-11-24T06:13:41.953367+0000","last_active":"2023-11-24T06:13:43.021029+0000","last_peered":"2023-11-24T06:13:43.021029+0000","last_clean":"2023-11-24T06:13:43.021029+0000","last_became_active":"2023-11-24T06:13:41.952985+0000","last_became_peered":"2023-11-24T06:13:41.952985+0000","last_unstale":"2023-11-24T06:13:43.021029+0000","last_undegraded":"2023-11-24T06:13:43.021029+0000","last_fullsized":"2023-11-24T06:13:43.021029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:32:58.913791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706125+0000","last_change":"2023-11-24T06:13:40.932963+0000","last_active":"2023-11-24T06:13:42.706125+0000","last_peered":"2023-11-24T06:13:42.706125+0000","last_clean":"2023-11-24T06:13:42.706125+0000","last_became_active":"2023-11-24T06:13:40.932634+0000","last_became_peered":"2023-11-24T06:13:40.932634+0000","last_unstale":"2023-11-24T06:13:42.706125+0000","last_undegraded":"2023-11-24T06:13:42.706125+0000","last_fullsized":"2023-11-24T06:13:42.706125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020928+0000","last_change":"2023-11-24T06:13:41.939776+0000","last_active":"2023-11-24T06:13:43.020928+0000","last_peered":"2023-11-24T06:13:43.020928+0000","last_clean":"2023-11-24T06:13:43.020928+0000","last_became_active":"2023-11-24T06:13:41.939488+0000","last_became_peered":"2023-11-24T06:13:41.939488+0000","last_unstale":"2023-11-24T06:13:43.020928+0000","last_undegraded":"2023-11-24T06:13:43.020928+0000","last_fullsized":"2023-11-24T06:13:43.020928+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702963+0000","last_change":"2023-11-24T06:13:40.931993+0000","last_active":"2023-11-24T06:13:42.702963+0000","last_peered":"2023-11-24T06:13:42.702963+0000","last_clean":"2023-11-24T06:13:42.702963+0000","last_became_active":"2023-11-24T06:13:40.931611+0000","last_became_peered":"2023-11-24T06:13:40.931611+0000","last_unstale":"2023-11-24T06:13:42.702963+0000","last_undegraded":"2023-11-24T06:13:42.702963+0000","last_fullsized":"2023-11-24T06:13:42.702963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932730+0000","last_change":"2023-11-24T06:13:41.948915+0000","last_active":"2023-11-24T06:13:42.932730+0000","last_peered":"2023-11-24T06:13:42.932730+0000","last_clean":"2023-11-24T06:13:42.932730+0000","last_became_active":"2023-11-24T06:13:41.948645+0000","last_became_peered":"2023-11-24T06:13:41.948645+0000","last_unstale":"2023-11-24T06:13:42.932730+0000","last_undegraded":"2023-11-24T06:13:42.932730+0000","last_fullsized":"2023-11-24T06:13:42.932730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:04:43.089628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705748+0000","last_change":"2023-11-24T06:13:40.926099+0000","last_active":"2023-11-24T06:13:42.705748+0000","last_peered":"2023-11-24T06:13:42.705748+0000","last_clean":"2023-11-24T06:13:42.705748+0000","last_became_active":"2023-11-24T06:13:40.925868+0000","last_became_peered":"2023-11-24T06:13:40.925868+0000","last_unstale":"2023-11-24T06:13:42.705748+0000","last_undegraded":"2023-11-24T06:13:42.705748+0000","last_fullsized":"2023-11-24T06:13:42.705748+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:18.758290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021391+0000","last_change":"2023-11-24T06:13:41.948132+0000","last_active":"2023-11-24T06:13:43.021391+0000","last_peered":"2023-11-24T06:13:43.021391+0000","last_clean":"2023-11-24T06:13:43.021391+0000","last_became_active":"2023-11-24T06:13:41.947078+0000","last_became_peered":"2023-11-24T06:13:41.947078+0000","last_unstale":"2023-11-24T06:13:43.021391+0000","last_undegraded":"2023-11-24T06:13:43.021391+0000","last_fullsized":"2023-11-24T06:13:43.021391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:10:57.304099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.709575+0000","last_change":"2023-11-24T06:13:40.929234+0000","last_active":"2023-11-24T06:13:42.709575+0000","last_peered":"2023-11-24T06:13:42.709575+0000","last_clean":"2023-11-24T06:13:42.709575+0000","last_became_active":"2023-11-24T06:13:40.929029+0000","last_became_peered":"2023-11-24T06:13:40.929029+0000","last_unstale":"2023-11-24T06:13:42.709575+0000","last_undegraded":"2023-11-24T06:13:42.709575+0000","last_fullsized":"2023-11-24T06:13:42.709575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020901+0000","last_change":"2023-11-24T06:13:41.948004+0000","last_active":"2023-11-24T06:13:43.020901+0000","last_peered":"2023-11-24T06:13:43.020901+0000","last_clean":"2023-11-24T06:13:43.020901+0000","last_became_active":"2023-11-24T06:13:41.947739+0000","last_became_peered":"2023-11-24T06:13:41.947739+0000","last_unstale":"2023-11-24T06:13:43.020901+0000","last_undegraded":"2023-11-24T06:13:43.020901+0000","last_fullsized":"2023-11-24T06:13:43.020901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:30.976529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706036+0000","last_change":"2023-11-24T06:13:40.930439+0000","last_active":"2023-11-24T06:13:42.706036+0000","last_peered":"2023-11-24T06:13:42.706036+0000","last_clean":"2023-11-24T06:13:42.706036+0000","last_became_active":"2023-11-24T06:13:40.930080+0000","last_became_peered":"2023-11-24T06:13:40.930080+0000","last_unstale":"2023-11-24T06:13:42.706036+0000","last_undegraded":"2023-11-24T06:13:42.706036+0000","last_fullsized":"2023-11-24T06:13:42.706036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020886+0000","last_change":"2023-11-24T06:13:41.947175+0000","last_active":"2023-11-24T06:13:43.020886+0000","last_peered":"2023-11-24T06:13:43.020886+0000","last_clean":"2023-11-24T06:13:43.020886+0000","last_became_active":"2023-11-24T06:13:41.946843+0000","last_became_peered":"2023-11-24T06:13:41.946843+0000","last_unstale":"2023-11-24T06:13:43.020886+0000","last_undegraded":"2023-11-24T06:13:43.020886+0000","last_fullsized":"2023-11-24T06:13:43.020886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:12:12.260097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705699+0000","last_change":"2023-11-24T06:13:40.921437+0000","last_active":"2023-11-24T06:13:42.705699+0000","last_peered":"2023-11-24T06:13:42.705699+0000","last_clean":"2023-11-24T06:13:42.705699+0000","last_became_active":"2023-11-24T06:13:40.921152+0000","last_became_peered":"2023-11-24T06:13:40.921152+0000","last_unstale":"2023-11-24T06:13:42.705699+0000","last_undegraded":"2023-11-24T06:13:42.705699+0000","last_fullsized":"2023-11-24T06:13:42.705699+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:04:02.442599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932894+0000","last_change":"2023-11-24T06:13:41.936911+0000","last_active":"2023-11-24T06:13:42.932894+0000","last_peered":"2023-11-24T06:13:42.932894+0000","last_clean":"2023-11-24T06:13:42.932894+0000","last_became_active":"2023-11-24T06:13:41.936435+0000","last_became_peered":"2023-11-24T06:13:41.936435+0000","last_unstale":"2023-11-24T06:13:42.932894+0000","last_undegraded":"2023-11-24T06:13:42.932894+0000","last_fullsized":"2023-11-24T06:13:42.932894+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702870+0000","last_change":"2023-11-24T06:13:40.931092+0000","last_active":"2023-11-24T06:13:42.702870+0000","last_peered":"2023-11-24T06:13:42.702870+0000","last_clean":"2023-11-24T06:13:42.702870+0000","last_became_active":"2023-11-24T06:13:40.930714+0000","last_became_peered":"2023-11-24T06:13:40.930714+0000","last_unstale":"2023-11-24T06:13:42.702870+0000","last_undegraded":"2023-11-24T06:13:42.702870+0000","last_fullsized":"2023-11-24T06:13:42.702870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020685+0000","last_change":"2023-11-24T06:13:41.946022+0000","last_active":"2023-11-24T06:13:43.020685+0000","last_peered":"2023-11-24T06:13:43.020685+0000","last_clean":"2023-11-24T06:13:43.020685+0000","last_became_active":"2023-11-24T06:13:41.945555+0000","last_became_peered":"2023-11-24T06:13:41.945555+0000","last_unstale":"2023-11-24T06:13:43.020685+0000","last_undegraded":"2023-11-24T06:13:43.020685+0000","last_fullsized":"2023-11-24T06:13:43.020685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.710687+0000","last_change":"2023-11-24T06:13:40.928444+0000","last_active":"2023-11-24T06:13:42.710687+0000","last_peered":"2023-11-24T06:13:42.710687+0000","last_clean":"2023-11-24T06:13:42.710687+0000","last_became_active":"2023-11-24T06:13:40.928116+0000","last_became_peered":"2023-11-24T06:13:40.928116+0000","last_unstale":"2023-11-24T06:13:42.710687+0000","last_undegraded":"2023-11-24T06:13:42.710687+0000","last_fullsized":"2023-11-24T06:13:42.710687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021211+0000","last_change":"2023-11-24T06:13:41.952432+0000","last_active":"2023-11-24T06:13:43.021211+0000","last_peered":"2023-11-24T06:13:43.021211+0000","last_clean":"2023-11-24T06:13:43.021211+0000","last_became_active":"2023-11-24T06:13:41.952182+0000","last_became_peered":"2023-11-24T06:13:41.952182+0000","last_unstale":"2023-11-24T06:13:43.021211+0000","last_undegraded":"2023-11-24T06:13:43.021211+0000","last_fullsized":"2023-11-24T06:13:43.021211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:32:58.913791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702924+0000","last_change":"2023-11-24T06:13:40.929215+0000","last_active":"2023-11-24T06:13:42.702924+0000","last_peered":"2023-11-24T06:13:42.702924+0000","last_clean":"2023-11-24T06:13:42.702924+0000","last_became_active":"2023-11-24T06:13:40.928931+0000","last_became_peered":"2023-11-24T06:13:40.928931+0000","last_unstale":"2023-11-24T06:13:42.702924+0000","last_undegraded":"2023-11-24T06:13:42.702924+0000","last_fullsized":"2023-11-24T06:13:42.702924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020996+0000","last_change":"2023-11-24T06:13:41.944099+0000","last_active":"2023-11-24T06:13:43.020996+0000","last_peered":"2023-11-24T06:13:43.020996+0000","last_clean":"2023-11-24T06:13:43.020996+0000","last_became_active":"2023-11-24T06:13:41.943810+0000","last_became_peered":"2023-11-24T06:13:41.943810+0000","last_unstale":"2023-11-24T06:13:43.020996+0000","last_undegraded":"2023-11-24T06:13:43.020996+0000","last_fullsized":"2023-11-24T06:13:43.020996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:02:16.555831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706026+0000","last_change":"2023-11-24T06:13:40.931296+0000","last_active":"2023-11-24T06:13:42.706026+0000","last_peered":"2023-11-24T06:13:42.706026+0000","last_clean":"2023-11-24T06:13:42.706026+0000","last_became_active":"2023-11-24T06:13:40.931008+0000","last_became_peered":"2023-11-24T06:13:40.931008+0000","last_unstale":"2023-11-24T06:13:42.706026+0000","last_undegraded":"2023-11-24T06:13:42.706026+0000","last_fullsized":"2023-11-24T06:13:42.706026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:29.969466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932403+0000","last_change":"2023-11-24T06:13:41.941033+0000","last_active":"2023-11-24T06:13:42.932403+0000","last_peered":"2023-11-24T06:13:42.932403+0000","last_clean":"2023-11-24T06:13:42.932403+0000","last_became_active":"2023-11-24T06:13:41.940774+0000","last_became_peered":"2023-11-24T06:13:41.940774+0000","last_unstale":"2023-11-24T06:13:42.932403+0000","last_undegraded":"2023-11-24T06:13:42.932403+0000","last_fullsized":"2023-11-24T06:13:42.932403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931646+0000","last_change":"2023-11-24T06:13:41.940234+0000","last_active":"2023-11-24T06:13:42.931646+0000","last_peered":"2023-11-24T06:13:42.931646+0000","last_clean":"2023-11-24T06:13:42.931646+0000","last_became_active":"2023-11-24T06:13:41.939983+0000","last_became_peered":"2023-11-24T06:13:41.939983+0000","last_unstale":"2023-11-24T06:13:42.931646+0000","last_undegraded":"2023-11-24T06:13:42.931646+0000","last_fullsized":"2023-11-24T06:13:42.931646+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:45.959354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702906+0000","last_change":"2023-11-24T06:13:40.925168+0000","last_active":"2023-11-24T06:13:42.702906+0000","last_peered":"2023-11-24T06:13:42.702906+0000","last_clean":"2023-11-24T06:13:42.702906+0000","last_became_active":"2023-11-24T06:13:40.924883+0000","last_became_peered":"2023-11-24T06:13:40.924883+0000","last_unstale":"2023-11-24T06:13:42.702906+0000","last_undegraded":"2023-11-24T06:13:42.702906+0000","last_fullsized":"2023-11-24T06:13:42.702906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020408+0000","last_change":"2023-11-24T06:13:41.952514+0000","last_active":"2023-11-24T06:13:43.020408+0000","last_peered":"2023-11-24T06:13:43.020408+0000","last_clean":"2023-11-24T06:13:43.020408+0000","last_became_active":"2023-11-24T06:13:41.952318+0000","last_became_peered":"2023-11-24T06:13:41.952318+0000","last_unstale":"2023-11-24T06:13:43.020408+0000","last_undegraded":"2023-11-24T06:13:43.020408+0000","last_fullsized":"2023-11-24T06:13:43.020408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.706050+0000","last_change":"2023-11-24T06:13:40.928925+0000","last_active":"2023-11-24T06:13:42.706050+0000","last_peered":"2023-11-24T06:13:42.706050+0000","last_clean":"2023-11-24T06:13:42.706050+0000","last_became_active":"2023-11-24T06:13:40.928516+0000","last_became_peered":"2023-11-24T06:13:40.928516+0000","last_unstale":"2023-11-24T06:13:42.706050+0000","last_undegraded":"2023-11-24T06:13:42.706050+0000","last_fullsized":"2023-11-24T06:13:42.706050+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":165,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:41.930933+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:13:41.930933+0000","last_peered":"2023-11-24T06:13:41.930933+0000","last_clean":"2023-11-24T06:13:41.930933+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:13:41.930933+0000","last_undegraded":"2023-11-24T06:13:41.930933+0000","last_fullsized":"2023-11-24T06:13:41.930933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020539+0000","last_change":"2023-11-24T06:13:41.941594+0000","last_active":"2023-11-24T06:13:43.020539+0000","last_peered":"2023-11-24T06:13:43.020539+0000","last_clean":"2023-11-24T06:13:43.020539+0000","last_became_active":"2023-11-24T06:13:41.940870+0000","last_became_peered":"2023-11-24T06:13:41.940870+0000","last_unstale":"2023-11-24T06:13:43.020539+0000","last_undegraded":"2023-11-24T06:13:43.020539+0000","last_fullsized":"2023-11-24T06:13:43.020539+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:57:19.765353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705156+0000","last_change":"2023-11-24T06:13:40.936258+0000","last_active":"2023-11-24T06:13:42.705156+0000","last_peered":"2023-11-24T06:13:42.705156+0000","last_clean":"2023-11-24T06:13:42.705156+0000","last_became_active":"2023-11-24T06:13:40.936027+0000","last_became_peered":"2023-11-24T06:13:40.936027+0000","last_unstale":"2023-11-24T06:13:42.705156+0000","last_undegraded":"2023-11-24T06:13:42.705156+0000","last_fullsized":"2023-11-24T06:13:42.705156+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:46:44.952291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705301+0000","last_change":"2023-11-24T06:13:40.935763+0000","last_active":"2023-11-24T06:13:42.705301+0000","last_peered":"2023-11-24T06:13:42.705301+0000","last_clean":"2023-11-24T06:13:42.705301+0000","last_became_active":"2023-11-24T06:13:40.935501+0000","last_became_peered":"2023-11-24T06:13:40.935501+0000","last_unstale":"2023-11-24T06:13:42.705301+0000","last_undegraded":"2023-11-24T06:13:42.705301+0000","last_fullsized":"2023-11-24T06:13:42.705301+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:39.819053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931777+0000","last_change":"2023-11-24T06:13:41.939692+0000","last_active":"2023-11-24T06:13:42.931777+0000","last_peered":"2023-11-24T06:13:42.931777+0000","last_clean":"2023-11-24T06:13:42.931777+0000","last_became_active":"2023-11-24T06:13:41.939436+0000","last_became_peered":"2023-11-24T06:13:41.939436+0000","last_unstale":"2023-11-24T06:13:42.931777+0000","last_undegraded":"2023-11-24T06:13:42.931777+0000","last_fullsized":"2023-11-24T06:13:42.931777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931858+0000","last_change":"2023-11-24T06:13:40.929038+0000","last_active":"2023-11-24T06:13:42.931858+0000","last_peered":"2023-11-24T06:13:42.931858+0000","last_clean":"2023-11-24T06:13:42.931858+0000","last_became_active":"2023-11-24T06:13:40.928695+0000","last_became_peered":"2023-11-24T06:13:40.928695+0000","last_unstale":"2023-11-24T06:13:42.931858+0000","last_undegraded":"2023-11-24T06:13:42.931858+0000","last_fullsized":"2023-11-24T06:13:42.931858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:45.387302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021113+0000","last_change":"2023-11-24T06:13:41.951155+0000","last_active":"2023-11-24T06:13:43.021113+0000","last_peered":"2023-11-24T06:13:43.021113+0000","last_clean":"2023-11-24T06:13:43.021113+0000","last_became_active":"2023-11-24T06:13:41.950865+0000","last_became_peered":"2023-11-24T06:13:41.950865+0000","last_unstale":"2023-11-24T06:13:43.021113+0000","last_undegraded":"2023-11-24T06:13:43.021113+0000","last_fullsized":"2023-11-24T06:13:43.021113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705823+0000","last_change":"2023-11-24T06:13:40.928532+0000","last_active":"2023-11-24T06:13:42.705823+0000","last_peered":"2023-11-24T06:13:42.705823+0000","last_clean":"2023-11-24T06:13:42.705823+0000","last_became_active":"2023-11-24T06:13:40.928254+0000","last_became_peered":"2023-11-24T06:13:40.928254+0000","last_unstale":"2023-11-24T06:13:42.705823+0000","last_undegraded":"2023-11-24T06:13:42.705823+0000","last_fullsized":"2023-11-24T06:13:42.705823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020537+0000","last_change":"2023-11-24T06:13:41.938598+0000","last_active":"2023-11-24T06:13:43.020537+0000","last_peered":"2023-11-24T06:13:43.020537+0000","last_clean":"2023-11-24T06:13:43.020537+0000","last_became_active":"2023-11-24T06:13:41.938250+0000","last_became_peered":"2023-11-24T06:13:41.938250+0000","last_unstale":"2023-11-24T06:13:43.020537+0000","last_undegraded":"2023-11-24T06:13:43.020537+0000","last_fullsized":"2023-11-24T06:13:43.020537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:53.426043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705123+0000","last_change":"2023-11-24T06:13:40.935938+0000","last_active":"2023-11-24T06:13:42.705123+0000","last_peered":"2023-11-24T06:13:42.705123+0000","last_clean":"2023-11-24T06:13:42.705123+0000","last_became_active":"2023-11-24T06:13:40.935654+0000","last_became_peered":"2023-11-24T06:13:40.935654+0000","last_unstale":"2023-11-24T06:13:42.705123+0000","last_undegraded":"2023-11-24T06:13:42.705123+0000","last_fullsized":"2023-11-24T06:13:42.705123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:42:52.418980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932278+0000","last_change":"2023-11-24T06:13:41.943430+0000","last_active":"2023-11-24T06:13:42.932278+0000","last_peered":"2023-11-24T06:13:42.932278+0000","last_clean":"2023-11-24T06:13:42.932278+0000","last_became_active":"2023-11-24T06:13:41.940218+0000","last_became_peered":"2023-11-24T06:13:41.940218+0000","last_unstale":"2023-11-24T06:13:42.932278+0000","last_undegraded":"2023-11-24T06:13:42.932278+0000","last_fullsized":"2023-11-24T06:13:42.932278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:26:46.394365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702855+0000","last_change":"2023-11-24T06:13:40.934827+0000","last_active":"2023-11-24T06:13:42.702855+0000","last_peered":"2023-11-24T06:13:42.702855+0000","last_clean":"2023-11-24T06:13:42.702855+0000","last_became_active":"2023-11-24T06:13:40.934569+0000","last_became_peered":"2023-11-24T06:13:40.934569+0000","last_unstale":"2023-11-24T06:13:42.702855+0000","last_undegraded":"2023-11-24T06:13:42.702855+0000","last_fullsized":"2023-11-24T06:13:42.702855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:16.006515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020153+0000","last_change":"2023-11-24T06:13:41.952768+0000","last_active":"2023-11-24T06:13:43.020153+0000","last_peered":"2023-11-24T06:13:43.020153+0000","last_clean":"2023-11-24T06:13:43.020153+0000","last_became_active":"2023-11-24T06:13:41.952505+0000","last_became_peered":"2023-11-24T06:13:41.952505+0000","last_unstale":"2023-11-24T06:13:43.020153+0000","last_undegraded":"2023-11-24T06:13:43.020153+0000","last_fullsized":"2023-11-24T06:13:43.020153+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702892+0000","last_change":"2023-11-24T06:13:40.930150+0000","last_active":"2023-11-24T06:13:42.702892+0000","last_peered":"2023-11-24T06:13:42.702892+0000","last_clean":"2023-11-24T06:13:42.702892+0000","last_became_active":"2023-11-24T06:13:40.929863+0000","last_became_peered":"2023-11-24T06:13:40.929863+0000","last_unstale":"2023-11-24T06:13:42.702892+0000","last_undegraded":"2023-11-24T06:13:42.702892+0000","last_fullsized":"2023-11-24T06:13:42.702892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020417+0000","last_change":"2023-11-24T06:13:41.951171+0000","last_active":"2023-11-24T06:13:43.020417+0000","last_peered":"2023-11-24T06:13:43.020417+0000","last_clean":"2023-11-24T06:13:43.020417+0000","last_became_active":"2023-11-24T06:13:41.950836+0000","last_became_peered":"2023-11-24T06:13:41.950836+0000","last_unstale":"2023-11-24T06:13:43.020417+0000","last_undegraded":"2023-11-24T06:13:43.020417+0000","last_fullsized":"2023-11-24T06:13:43.020417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.705214+0000","last_change":"2023-11-24T06:13:40.934976+0000","last_active":"2023-11-24T06:13:42.705214+0000","last_peered":"2023-11-24T06:13:42.705214+0000","last_clean":"2023-11-24T06:13:42.705214+0000","last_became_active":"2023-11-24T06:13:40.934665+0000","last_became_peered":"2023-11-24T06:13:40.934665+0000","last_unstale":"2023-11-24T06:13:42.705214+0000","last_undegraded":"2023-11-24T06:13:42.705214+0000","last_fullsized":"2023-11-24T06:13:42.705214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:17.005869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933121+0000","last_change":"2023-11-24T06:13:41.938322+0000","last_active":"2023-11-24T06:13:42.933121+0000","last_peered":"2023-11-24T06:13:42.933121+0000","last_clean":"2023-11-24T06:13:42.933121+0000","last_became_active":"2023-11-24T06:13:41.938032+0000","last_became_peered":"2023-11-24T06:13:41.938032+0000","last_unstale":"2023-11-24T06:13:42.933121+0000","last_undegraded":"2023-11-24T06:13:42.933121+0000","last_fullsized":"2023-11-24T06:13:42.933121+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:08:15.628654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702916+0000","last_change":"2023-11-24T06:13:40.931158+0000","last_active":"2023-11-24T06:13:42.702916+0000","last_peered":"2023-11-24T06:13:42.702916+0000","last_clean":"2023-11-24T06:13:42.702916+0000","last_became_active":"2023-11-24T06:13:40.930820+0000","last_became_peered":"2023-11-24T06:13:40.930820+0000","last_unstale":"2023-11-24T06:13:42.702916+0000","last_undegraded":"2023-11-24T06:13:42.702916+0000","last_fullsized":"2023-11-24T06:13:42.702916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:00.555912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021416+0000","last_change":"2023-11-24T06:13:41.949647+0000","last_active":"2023-11-24T06:13:43.021416+0000","last_peered":"2023-11-24T06:13:43.021416+0000","last_clean":"2023-11-24T06:13:43.021416+0000","last_became_active":"2023-11-24T06:13:41.949346+0000","last_became_peered":"2023-11-24T06:13:41.949346+0000","last_unstale":"2023-11-24T06:13:43.021416+0000","last_undegraded":"2023-11-24T06:13:43.021416+0000","last_fullsized":"2023-11-24T06:13:43.021416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:14:02.905166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702952+0000","last_change":"2023-11-24T06:13:40.932491+0000","last_active":"2023-11-24T06:13:42.702952+0000","last_peered":"2023-11-24T06:13:42.702952+0000","last_clean":"2023-11-24T06:13:42.702952+0000","last_became_active":"2023-11-24T06:13:40.932251+0000","last_became_peered":"2023-11-24T06:13:40.932251+0000","last_unstale":"2023-11-24T06:13:42.702952+0000","last_undegraded":"2023-11-24T06:13:42.702952+0000","last_fullsized":"2023-11-24T06:13:42.702952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:37:49.980866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020655+0000","last_change":"2023-11-24T06:13:41.947115+0000","last_active":"2023-11-24T06:13:43.020655+0000","last_peered":"2023-11-24T06:13:43.020655+0000","last_clean":"2023-11-24T06:13:43.020655+0000","last_became_active":"2023-11-24T06:13:41.944203+0000","last_became_peered":"2023-11-24T06:13:41.944203+0000","last_unstale":"2023-11-24T06:13:43.020655+0000","last_undegraded":"2023-11-24T06:13:43.020655+0000","last_fullsized":"2023-11-24T06:13:43.020655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:25.437212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.702944+0000","last_change":"2023-11-24T06:13:40.926973+0000","last_active":"2023-11-24T06:13:42.702944+0000","last_peered":"2023-11-24T06:13:42.702944+0000","last_clean":"2023-11-24T06:13:42.702944+0000","last_became_active":"2023-11-24T06:13:40.926745+0000","last_became_peered":"2023-11-24T06:13:40.926745+0000","last_unstale":"2023-11-24T06:13:42.702944+0000","last_undegraded":"2023-11-24T06:13:42.702944+0000","last_fullsized":"2023-11-24T06:13:42.702944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:39.901614+0000","last_clean_scrub_stamp":"2023-11-24T06:13:39.901614+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:37:57.388385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021210+0000","last_change":"2023-11-24T06:13:41.946697+0000","last_active":"2023-11-24T06:13:43.021210+0000","last_peered":"2023-11-24T06:13:43.021210+0000","last_clean":"2023-11-24T06:13:43.021210+0000","last_became_active":"2023-11-24T06:13:41.946341+0000","last_became_peered":"2023-11-24T06:13:41.946341+0000","last_unstale":"2023-11-24T06:13:43.021210+0000","last_undegraded":"2023-11-24T06:13:43.021210+0000","last_fullsized":"2023-11-24T06:13:43.021210+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:02:16.555831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.932724+0000","last_change":"2023-11-24T06:13:41.936743+0000","last_active":"2023-11-24T06:13:42.932724+0000","last_peered":"2023-11-24T06:13:42.932724+0000","last_clean":"2023-11-24T06:13:42.932724+0000","last_became_active":"2023-11-24T06:13:41.936048+0000","last_became_peered":"2023-11-24T06:13:41.936048+0000","last_unstale":"2023-11-24T06:13:42.932724+0000","last_undegraded":"2023-11-24T06:13:42.932724+0000","last_fullsized":"2023-11-24T06:13:42.932724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:50:50.666286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.019940+0000","last_change":"2023-11-24T06:13:41.951555+0000","last_active":"2023-11-24T06:13:43.019940+0000","last_peered":"2023-11-24T06:13:43.019940+0000","last_clean":"2023-11-24T06:13:43.019940+0000","last_became_active":"2023-11-24T06:13:41.951290+0000","last_became_peered":"2023-11-24T06:13:41.951290+0000","last_unstale":"2023-11-24T06:13:43.019940+0000","last_undegraded":"2023-11-24T06:13:43.019940+0000","last_fullsized":"2023-11-24T06:13:43.019940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:19:29.062604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020806+0000","last_change":"2023-11-24T06:13:41.945563+0000","last_active":"2023-11-24T06:13:43.020806+0000","last_peered":"2023-11-24T06:13:43.020806+0000","last_clean":"2023-11-24T06:13:43.020806+0000","last_became_active":"2023-11-24T06:13:41.943916+0000","last_became_peered":"2023-11-24T06:13:41.943916+0000","last_unstale":"2023-11-24T06:13:43.020806+0000","last_undegraded":"2023-11-24T06:13:43.020806+0000","last_fullsized":"2023-11-24T06:13:43.020806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021437+0000","last_change":"2023-11-24T06:13:41.943045+0000","last_active":"2023-11-24T06:13:43.021437+0000","last_peered":"2023-11-24T06:13:43.021437+0000","last_clean":"2023-11-24T06:13:43.021437+0000","last_became_active":"2023-11-24T06:13:41.942182+0000","last_became_peered":"2023-11-24T06:13:41.942182+0000","last_unstale":"2023-11-24T06:13:43.021437+0000","last_undegraded":"2023-11-24T06:13:43.021437+0000","last_fullsized":"2023-11-24T06:13:43.021437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021155+0000","last_change":"2023-11-24T06:13:41.950138+0000","last_active":"2023-11-24T06:13:43.021155+0000","last_peered":"2023-11-24T06:13:43.021155+0000","last_clean":"2023-11-24T06:13:43.021155+0000","last_became_active":"2023-11-24T06:13:41.949872+0000","last_became_peered":"2023-11-24T06:13:41.949872+0000","last_unstale":"2023-11-24T06:13:43.021155+0000","last_undegraded":"2023-11-24T06:13:43.021155+0000","last_fullsized":"2023-11-24T06:13:43.021155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:57:27.971739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.931823+0000","last_change":"2023-11-24T06:13:41.942213+0000","last_active":"2023-11-24T06:13:42.931823+0000","last_peered":"2023-11-24T06:13:42.931823+0000","last_clean":"2023-11-24T06:13:42.931823+0000","last_became_active":"2023-11-24T06:13:41.941946+0000","last_became_peered":"2023-11-24T06:13:41.941946+0000","last_unstale":"2023-11-24T06:13:42.931823+0000","last_undegraded":"2023-11-24T06:13:42.931823+0000","last_fullsized":"2023-11-24T06:13:42.931823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933472+0000","last_change":"2023-11-24T06:13:41.954479+0000","last_active":"2023-11-24T06:13:42.933472+0000","last_peered":"2023-11-24T06:13:42.933472+0000","last_clean":"2023-11-24T06:13:42.933472+0000","last_became_active":"2023-11-24T06:13:41.954180+0000","last_became_peered":"2023-11-24T06:13:41.954180+0000","last_unstale":"2023-11-24T06:13:42.933472+0000","last_undegraded":"2023-11-24T06:13:42.933472+0000","last_fullsized":"2023-11-24T06:13:42.933472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020983+0000","last_change":"2023-11-24T06:13:41.950255+0000","last_active":"2023-11-24T06:13:43.020983+0000","last_peered":"2023-11-24T06:13:43.020983+0000","last_clean":"2023-11-24T06:13:43.020983+0000","last_became_active":"2023-11-24T06:13:41.949950+0000","last_became_peered":"2023-11-24T06:13:41.949950+0000","last_unstale":"2023-11-24T06:13:43.020983+0000","last_undegraded":"2023-11-24T06:13:43.020983+0000","last_fullsized":"2023-11-24T06:13:43.020983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020326+0000","last_change":"2023-11-24T06:13:41.945908+0000","last_active":"2023-11-24T06:13:43.020326+0000","last_peered":"2023-11-24T06:13:43.020326+0000","last_clean":"2023-11-24T06:13:43.020326+0000","last_became_active":"2023-11-24T06:13:41.945619+0000","last_became_peered":"2023-11-24T06:13:41.945619+0000","last_unstale":"2023-11-24T06:13:43.020326+0000","last_undegraded":"2023-11-24T06:13:43.020326+0000","last_fullsized":"2023-11-24T06:13:43.020326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:48:59.038609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020526+0000","last_change":"2023-11-24T06:13:41.955593+0000","last_active":"2023-11-24T06:13:43.020526+0000","last_peered":"2023-11-24T06:13:43.020526+0000","last_clean":"2023-11-24T06:13:43.020526+0000","last_became_active":"2023-11-24T06:13:41.955287+0000","last_became_peered":"2023-11-24T06:13:41.955287+0000","last_unstale":"2023-11-24T06:13:43.020526+0000","last_undegraded":"2023-11-24T06:13:43.020526+0000","last_fullsized":"2023-11-24T06:13:43.020526+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:59:02.737166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.020615+0000","last_change":"2023-11-24T06:13:41.948053+0000","last_active":"2023-11-24T06:13:43.020615+0000","last_peered":"2023-11-24T06:13:43.020615+0000","last_clean":"2023-11-24T06:13:43.020615+0000","last_became_active":"2023-11-24T06:13:41.947768+0000","last_became_peered":"2023-11-24T06:13:41.947768+0000","last_unstale":"2023-11-24T06:13:43.020615+0000","last_undegraded":"2023-11-24T06:13:43.020615+0000","last_fullsized":"2023-11-24T06:13:43.020615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:25:36.850823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:43.021358+0000","last_change":"2023-11-24T06:13:41.948146+0000","last_active":"2023-11-24T06:13:43.021358+0000","last_peered":"2023-11-24T06:13:43.021358+0000","last_clean":"2023-11-24T06:13:43.021358+0000","last_became_active":"2023-11-24T06:13:41.947853+0000","last_became_peered":"2023-11-24T06:13:41.947853+0000","last_unstale":"2023-11-24T06:13:43.021358+0000","last_undegraded":"2023-11-24T06:13:43.021358+0000","last_fullsized":"2023-11-24T06:13:43.021358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:39:26.370866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-24T06:13:42.933070+0000","last_change":"2023-11-24T06:13:41.939852+0000","last_active":"2023-11-24T06:13:42.933070+0000","last_peered":"2023-11-24T06:13:42.933070+0000","last_clean":"2023-11-24T06:13:42.933070+0000","last_became_active":"2023-11-24T06:13:41.939587+0000","last_became_peered":"2023-11-24T06:13:41.939587+0000","last_unstale":"2023-11-24T06:13:42.933070+0000","last_undegraded":"2023-11-24T06:13:42.933070+0000","last_fullsized":"2023-11-24T06:13:42.933070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:40.908677+0000","last_clean_scrub_stamp":"2023-11-24T06:13:40.908677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:19:40.826116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8530000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.1459999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":71070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":70910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":72522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":71036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:13:51.029 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:13:51.029 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-24T06:13:51.030 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-24T06:13:51.030 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-24T06:13:51.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.181+0000 7f65a3cfa700 1 Processor -- start 2023-11-24T06:13:51.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 -- start start 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f659c0d2240 0x7f659c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f659c15e1b0 0x7f659c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0b1d40 con 0x7f659c15ddd0 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c0b28c0 con 0x7f659c15e1b0 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.182+0000 7f65a3cfa700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c06c000 con 0x7f659c0d2240 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f659c15e1b0 0x7f659c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a1a96700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f659c15ddd0 0x7f659c0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38494/0 (socket says 172.21.15.106:38494) 2023-11-24T06:13:51.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a1a96700 1 -- 172.21.15.106:0/793462427 learned_addr learned my addr 172.21.15.106:0/793462427 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a1295700 1 --2- 172.21.15.106:0/793462427 >> v2:172.21.15.176:3300/0 conn(0x7f659c0d2240 0x7f659c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 -- 172.21.15.106:0/793462427 >> v2:172.21.15.176:3300/0 conn(0x7f659c0d2240 msgr2=0x7f659c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 --2- 172.21.15.106:0/793462427 >> v2:172.21.15.176:3300/0 conn(0x7f659c0d2240 0x7f659c0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 -- 172.21.15.106:0/793462427 >> v1:172.21.15.106:6789/0 conn(0x7f659c15ddd0 legacy=0x7f659c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a0a94700 1 -- 172.21.15.106:0/793462427 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321085871 0 0) 0x7f659c0b1d40 con 0x7f659c15ddd0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 -- 172.21.15.106:0/793462427 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c0b1f90 con 0x7f659c15e1b0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a2297700 1 --2- 172.21.15.106:0/793462427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0cf000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6594009d90 tx=0x7f659400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17f3ef7dc0110ea5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a0a94700 1 -- 172.21.15.106:0/793462427 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659400e070 con 0x7f659c15e1b0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a0a94700 1 -- 172.21.15.106:0/793462427 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659400bb90 con 0x7f659c15e1b0 2023-11-24T06:13:51.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.183+0000 7f65a0a94700 1 -- 172.21.15.106:0/793462427 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594012430 con 0x7f659c15e1b0 2023-11-24T06:13:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 -- 172.21.15.106:0/793462427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 msgr2=0x7f659c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/793462427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0cf000 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6594009d90 tx=0x7f659400b330 comp rx=0 tx=0).stop 2023-11-24T06:13:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 -- 172.21.15.106:0/793462427 shutdown_connections 2023-11-24T06:13:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/793462427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0cf000 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/793462427 >> v2:172.21.15.176:3300/0 conn(0x7f659c0d2240 0x7f659c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 -- 172.21.15.106:0/793462427 >> 172.21.15.106:0/793462427 conn(0x7f659c0731a0 msgr2=0x7f659c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 -- 172.21.15.106:0/793462427 shutdown_connections 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.184+0000 7f65a3cfa700 1 -- 172.21.15.106:0/793462427 wait complete. 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.185+0000 7f65a3cfa700 1 Processor -- start 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.185+0000 7f65a3cfa700 1 -- start start 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c0d2240 0x7f659c153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c15ddd0 0x7f659c0aee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c1537b0 con 0x7f659c15e1b0 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c1f43a0 con 0x7f659c15ddd0 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c1f4680 con 0x7f659c0d2240 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58242/0 (socket says 172.21.15.106:58242) 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 -- 172.21.15.106:0/530288468 learned_addr learned my addr 172.21.15.106:0/530288468 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a1295700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c15ddd0 0x7f659c0aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a1a96700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c0d2240 0x7f659c153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 -- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c0d2240 msgr2=0x7f659c153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c0d2240 0x7f659c153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 -- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c15ddd0 msgr2=0x7f659c0aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c15ddd0 0x7f659c0aee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 -- 172.21.15.106:0/530288468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6594009a70 con 0x7f659c15e1b0 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a2297700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6594014040 tx=0x7f6594004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594012430 con 0x7f659c15e1b0 2023-11-24T06:13:51.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594020070 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c0b2ed0 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.186+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594004280 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.187+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c0b33c0 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.187+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c067f60 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.188+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f65940043e0 con 0x7f659c15e1b0 2023-11-24T06:13:51.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.188+0000 7f65927fc700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 0x7f658006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.188+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6594022070 con 0x7f659c15e1b0 2023-11-24T06:13:51.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.188+0000 7f65a1a96700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 0x7f658006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.189+0000 7f65a1a96700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 0x7f658006d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f658c000f60 tx=0x7f658c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.193+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6594056910 con 0x7f659c15e1b0 2023-11-24T06:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.423+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f659c0b2d30 con 0x7f659c15e1b0 2023-11-24T06:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.424+0000 7f65927fc700 1 -- 172.21.15.106:0/530288468 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f659c0b2d30 con 0x7f659c15e1b0 2023-11-24T06:13:51.427 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:51.427 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-24T06:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 msgr2=0x7f658006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 0x7f658006d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f658c000f60 tx=0x7f658c009040 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 msgr2=0x7f659c0af380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6594014040 tx=0x7f6594004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 shutdown_connections 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f658006aed0 0x7f658006d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f659c15e1b0 0x7f659c0af380 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f659c0d2240 0x7f659c153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 --2- 172.21.15.106:0/530288468 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f659c15ddd0 0x7f659c0aee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 >> 172.21.15.106:0/530288468 conn(0x7f659c0731a0 msgr2=0x7f659c0704f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 shutdown_connections 2023-11-24T06:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.426+0000 7f65a3cfa700 1 -- 172.21.15.106:0/530288468 wait complete. 2023-11-24T06:13:51.440 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-24T06:13:51.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:51.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.558+0000 7f378e04b700 1 Processor -- start 2023-11-24T06:13:51.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.558+0000 7f378e04b700 1 -- start start 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f378e04b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f37880b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f378e04b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880ae430 con 0x7f378815e080 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f378e04b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37880ae710 con 0x7f378806c710 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f378e04b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37880af0b0 con 0x7f37880af4d0 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f37877fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f378815e080 0x7f378806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38508/0 (socket says 172.21.15.106:38508) 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f37877fe700 1 -- 172.21.15.106:0/2836802655 learned_addr learned my addr 172.21.15.106:0/2836802655 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f3787fff700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f37880b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622460311 0 0) 0x7f37880ae430 con 0x7f378815e080 2023-11-24T06:13:51.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37700035b0 con 0x7f378815e080 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.559+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281970977 0 0) 0x7f37880ae710 con 0x7f378806c710 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37880ae430 con 0x7f378806c710 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3167120052 0 0) 0x7f37700035b0 con 0x7f378815e080 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 msgr2=0x7f37880b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f37880b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 >> v1:172.21.15.176:6789/0 conn(0x7f378806c710 legacy=0x7f378806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37880ae9f0 con 0x7f378815e080 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f377c001670 con 0x7f378815e080 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 >> v1:172.21.15.106:6789/0 conn(0x7f378815e080 legacy=0x7f378806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3770003bc0 0x7f3770003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3770004850 0x7f3770004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f3770005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37880af0b0 con 0x7f3770004850 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377000bac0 con 0x7f3770003bc0 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377000bc80 con 0x7f37880af4d0 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3770004850 0x7f3770004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37877fe700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3770003bc0 0x7f3770003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3787fff700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f3770005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 -- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 msgr2=0x7f3770005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f37880af4d0 0x7f3770005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 -- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3770003bc0 msgr2=0x7f3770003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3770003bc0 0x7f3770003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 -- 172.21.15.106:0/2836802655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700035b0 con 0x7f3770004850 2023-11-24T06:13:51.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f3786ffd700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3770004850 0x7f3770004cd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3778001940 tx=0x7f3770005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41321d457da4ad4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778001430 con 0x7f3770004850 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3778001d70 con 0x7f3770004850 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.560+0000 7f37867fc700 1 -- 172.21.15.106:0/2836802655 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778005510 con 0x7f3770004850 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 -- 172.21.15.106:0/2836802655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3770004850 msgr2=0x7f3770004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 --2- 172.21.15.106:0/2836802655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3770004850 0x7f3770004cd0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3778001940 tx=0x7f3770005880 comp rx=0 tx=0).stop 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f3787fff700 1 -- 172.21.15.106:0/2836802655 reap_dead start 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 -- 172.21.15.106:0/2836802655 shutdown_connections 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 -- 172.21.15.106:0/2836802655 >> 172.21.15.106:0/2836802655 conn(0x7f3788071b90 msgr2=0x7f3788071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 -- 172.21.15.106:0/2836802655 shutdown_connections 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.561+0000 7f378e04b700 1 -- 172.21.15.106:0/2836802655 wait complete. 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.562+0000 7f378e04b700 1 Processor -- start 2023-11-24T06:13:51.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.562+0000 7f378e04b700 1 -- start start 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3770004850 0x7f3788158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378815b1e0 0x7f37881f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37881f36a0 con 0x7f3788159fb0 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788158f10 con 0x7f378815b1e0 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f378e04b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37881591f0 con 0x7f3770004850 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58262/0 (socket says 172.21.15.106:58262) 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 -- 172.21.15.106:0/4011896147 learned_addr learned my addr 172.21.15.106:0/4011896147 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:51.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f37877fe700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3770004850 0x7f3788158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3786ffd700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378815b1e0 0x7f37881f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 -- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3770004850 msgr2=0x7f3788158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3770004850 0x7f3788158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 -- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378815b1e0 msgr2=0x7f37881f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378815b1e0 0x7f37881f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.563+0000 7f3787fff700 1 -- 172.21.15.106:0/4011896147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37881594d0 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f3787fff700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f378806d350 tx=0x7f3780011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000e040 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000f040 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37881597b0 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000fe40 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.564+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f378815b660 con 0x7f3788159fb0 2023-11-24T06:13:51.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.565+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3788159e00 con 0x7f3788159fb0 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.565+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3780015430 con 0x7f3788159fb0 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.565+0000 7f376ffff700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 0x7f377406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.565+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3780089c50 con 0x7f3788159fb0 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.565+0000 7f37877fe700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 0x7f377406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.566+0000 7f37877fe700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 0x7f377406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f377c001b60 tx=0x7f377c000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.570+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3780054d90 con 0x7f3788159fb0 2023-11-24T06:13:51.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.763+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37880753f0 con 0x7f3788159fb0 2023-11-24T06:13:51.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.764+0000 7f376ffff700 1 -- 172.21.15.106:0/4011896147 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f37800583b0 con 0x7f3788159fb0 2023-11-24T06:13:51.767 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:51.767 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.766+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 msgr2=0x7f377406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.766+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 0x7f377406d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f377c001b60 tx=0x7f377c000ed0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.766+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 msgr2=0x7f378806ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.766+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f378806d350 tx=0x7f3780011f60 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.766+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 shutdown_connections 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f377406aed0 0x7f377406d390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3788159fb0 0x7f378806ebb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3770004850 0x7f3788158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 --2- 172.21.15.106:0/4011896147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f378815b1e0 0x7f37881f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 >> 172.21.15.106:0/4011896147 conn(0x7f3788071b90 msgr2=0x7f37880af8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 shutdown_connections 2023-11-24T06:13:51.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.767+0000 7f378e04b700 1 -- 172.21.15.106:0/4011896147 wait complete. 2023-11-24T06:13:51.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:51.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:51.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.903+0000 7fedd2a36700 1 Processor -- start 2023-11-24T06:13:51.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.903+0000 7fedd2a36700 1 -- start start 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd2a36700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedcc15b370 0x7fedcc15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd2a36700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 0x7fedcc0b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd2a36700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedcc0ae5e0 con 0x7fedcc1587f0 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd2a36700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc0b4630 con 0x7fedcc15b370 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd2a36700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedcc15be30 con 0x7fedcc0b3c60 2023-11-24T06:13:51.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedcc15b370 0x7fedcc15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcbfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedcc1587f0 0x7fedcc06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38528/0 (socket says 172.21.15.106:38528) 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcbfff700 1 -- 172.21.15.106:0/1157123726 learned_addr learned my addr 172.21.15.106:0/1157123726 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd0fd3700 1 --2- 172.21.15.106:0/1157123726 >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 0x7fedcc0b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 -- 172.21.15.106:0/1157123726 >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 msgr2=0x7fedcc0b40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 --2- 172.21.15.106:0/1157123726 >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 0x7fedcc0b40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 -- 172.21.15.106:0/1157123726 >> v1:172.21.15.106:6789/0 conn(0x7fedcc1587f0 legacy=0x7fedcc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcaffd700 1 -- 172.21.15.106:0/1157123726 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3392098735 0 0) 0x7fedcc0ae5e0 con 0x7fedcc1587f0 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 -- 172.21.15.106:0/1157123726 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc15c110 con 0x7fedcc15b370 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedd0fd3700 1 --2- 172.21.15.106:0/1157123726 >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 0x7fedcc0b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcb7fe700 1 --2- 172.21.15.106:0/1157123726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc15b370 0x7fedcc15b800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009840 tx=0x7fedbc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8487475c88a149b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcaffd700 1 -- 172.21.15.106:0/1157123726 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011830 con 0x7fedcc15b370 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcaffd700 1 -- 172.21.15.106:0/1157123726 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc011990 con 0x7fedcc15b370 2023-11-24T06:13:51.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.904+0000 7fedcaffd700 1 -- 172.21.15.106:0/1157123726 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc011d20 con 0x7fedcc15b370 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 -- 172.21.15.106:0/1157123726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc15b370 msgr2=0x7fedcc15b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 --2- 172.21.15.106:0/1157123726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc15b370 0x7fedcc15b800 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fedbc009840 tx=0x7fedbc009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 -- 172.21.15.106:0/1157123726 shutdown_connections 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 --2- 172.21.15.106:0/1157123726 >> v2:172.21.15.176:3300/0 conn(0x7fedcc0b3c60 0x7fedcc0b40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 --2- 172.21.15.106:0/1157123726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc15b370 0x7fedcc15b800 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 -- 172.21.15.106:0/1157123726 >> 172.21.15.106:0/1157123726 conn(0x7fedcc0d0bf0 msgr2=0x7fedcc0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 -- 172.21.15.106:0/1157123726 shutdown_connections 2023-11-24T06:13:51.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.905+0000 7fedd2a36700 1 -- 172.21.15.106:0/1157123726 wait complete. 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.906+0000 7fedd2a36700 1 Processor -- start 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.906+0000 7fedd2a36700 1 -- start start 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedcc1587f0 0x7fedcc158bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedcc15b370 0x7fedcc1f0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc159110 con 0x7fedcc0b3c60 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc1f1460 con 0x7fedcc15b370 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd2a36700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedcc159340 con 0x7fedcc1587f0 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58272/0 (socket says 172.21.15.106:58272) 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 -- 172.21.15.106:0/2127654203 learned_addr learned my addr 172.21.15.106:0/2127654203 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcb7fe700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedcc1587f0 0x7fedcc158bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedd0fd3700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedcc15b370 0x7fedcc1f0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 -- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedcc1587f0 msgr2=0x7fedcc158bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedcc1587f0 0x7fedcc158bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 -- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedcc15b370 msgr2=0x7fedcc1f0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.907+0000 7fedcbfff700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedcc15b370 0x7fedcc1f0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedcbfff700 1 -- 172.21.15.106:0/2127654203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedbc0094a0 con 0x7fedcc0b3c60 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedcbfff700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedc00011e0 tx=0x7fedc000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0004c80 con 0x7fedcc0b3c60 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0004e00 con 0x7fedcc0b3c60 2023-11-24T06:13:51.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedcc159620 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0007310 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.908+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedcc159be0 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.909+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedcc068fb0 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.909+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedc0007470 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.910+0000 7fedc8ff9700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 0x7fedb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.910+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedc00893f0 con 0x7fedcc0b3c60 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.910+0000 7fedcb7fe700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 0x7fedb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:51.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.910+0000 7fedcb7fe700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 0x7fedb806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0090b0 tx=0x7fedbc01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:51.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:51.914+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fedc00544a0 con 0x7fedcc0b3c60 2023-11-24T06:13:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.105+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fedcc15a230 con 0x7fedcc0b3c60 2023-11-24T06:13:52.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.106+0000 7fedc8ff9700 1 -- 172.21.15.106:0/2127654203 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedc0057ac0 con 0x7fedcc0b3c60 2023-11-24T06:13:52.108 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 msgr2=0x7fedb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 0x7fedb806d390 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0090b0 tx=0x7fedbc01c040 comp rx=0 tx=0).stop 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 msgr2=0x7fedcc151340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fedc00011e0 tx=0x7fedc000cae0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 shutdown_connections 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806aed0 0x7fedb806d390 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedcc15b370 0x7fedcc1f0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedcc0b3c60 0x7fedcc151340 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 --2- 172.21.15.106:0/2127654203 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedcc1587f0 0x7fedcc158bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 >> 172.21.15.106:0/2127654203 conn(0x7fedcc0d0bf0 msgr2=0x7fedcc073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 shutdown_connections 2023-11-24T06:13:52.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.108+0000 7fedd2a36700 1 -- 172.21.15.106:0/2127654203 wait complete. 2023-11-24T06:13:52.122 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:52.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.242+0000 7f28ebf45700 1 Processor -- start 2023-11-24T06:13:52.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.242+0000 7f28ebf45700 1 -- start start 2023-11-24T06:13:52.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ebf45700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28e415e160 0x7f28e40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ebf45700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40b3c60 con 0x7f28e40746a0 2023-11-24T06:13:52.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ebf45700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e40b58c0 con 0x7f28e40afc90 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ebf45700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40b4500 con 0x7f28e415e160 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28e9ce1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28e415e160 0x7f28e40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ea4e2700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f28e40746a0 0x7f28e406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38544/0 (socket says 172.21.15.106:38544) 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.243+0000 7f28ea4e2700 1 -- 172.21.15.106:0/2349127189 learned_addr learned my addr 172.21.15.106:0/2349127189 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e9ce1700 1 -- 172.21.15.106:0/2349127189 >> v1:172.21.15.176:6789/0 conn(0x7f28e40afc90 legacy=0x7f28e4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e9ce1700 1 -- 172.21.15.106:0/2349127189 >> v1:172.21.15.106:6789/0 conn(0x7f28e40746a0 legacy=0x7f28e406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e9ce1700 1 -- 172.21.15.106:0/2349127189 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40b0140 con 0x7f28e415e160 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e8cdf700 1 -- 172.21.15.106:0/2349127189 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 767060148 0 0) 0x7f28e40b3c60 con 0x7f28e40746a0 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e9ce1700 1 --2- 172.21.15.106:0/2349127189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e415e160 0x7f28e40b5da0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009840 tx=0x7f28d4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa375003a1f2fff4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e8cdf700 1 -- 172.21.15.106:0/2349127189 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4004230 con 0x7f28e415e160 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e8cdf700 1 -- 172.21.15.106:0/2349127189 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4004390 con 0x7f28e415e160 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28e8cdf700 1 -- 172.21.15.106:0/2349127189 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d40036a0 con 0x7f28e415e160 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28ebf45700 1 -- 172.21.15.106:0/2349127189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e415e160 msgr2=0x7f28e40b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28ebf45700 1 --2- 172.21.15.106:0/2349127189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e415e160 0x7f28e40b5da0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f28d4009840 tx=0x7f28d4009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28ebf45700 1 -- 172.21.15.106:0/2349127189 shutdown_connections 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28ebf45700 1 --2- 172.21.15.106:0/2349127189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e415e160 0x7f28e40b5da0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.244+0000 7f28ebf45700 1 -- 172.21.15.106:0/2349127189 >> 172.21.15.106:0/2349127189 conn(0x7f28e40d0bf0 msgr2=0x7f28e40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.245+0000 7f28ebf45700 1 -- 172.21.15.106:0/2349127189 shutdown_connections 2023-11-24T06:13:52.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.245+0000 7f28ebf45700 1 -- 172.21.15.106:0/2349127189 wait complete. 2023-11-24T06:13:52.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 Processor -- start 2023-11-24T06:13:52.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 -- start start 2023-11-24T06:13:52.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 0x7f28e4148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 0x7f28e40c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4149a20 con 0x7f28e40afc90 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4148e10 con 0x7f28e40746a0 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28ebf45700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e41490f0 con 0x7f28e415e160 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.246+0000 7f28e94e0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58286/0 (socket says 172.21.15.106:58286) 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 -- 172.21.15.106:0/4220674019 learned_addr learned my addr 172.21.15.106:0/4220674019 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28ea4e2700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 0x7f28e40c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e9ce1700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 0x7f28e4148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 -- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 msgr2=0x7f28e40c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 0x7f28e40c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 -- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 msgr2=0x7f28e4148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 0x7f28e4148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 -- 172.21.15.106:0/4220674019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d40094a0 con 0x7f28e40afc90 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28ea4e2700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 0x7f28e40c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e9ce1700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 0x7f28e4148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28e94e0700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c4d0 tx=0x7f28e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0011790 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e00118f0 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e0011ca0 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28e41493d0 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.247+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e40c5df0 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.248+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e4149bd0 con 0x7f28e40afc90 2023-11-24T06:13:52.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.249+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28e001c460 con 0x7f28e40afc90 2023-11-24T06:13:52.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.249+0000 7f28da7fc700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 0x7f28c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.249+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28e00894e0 con 0x7f28e40afc90 2023-11-24T06:13:52.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.249+0000 7f28e9ce1700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 0x7f28c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.249+0000 7f28e9ce1700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 0x7f28c806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28e40d0050 tx=0x7f28d4013040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.253+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28e4149bd0 con 0x7f28e40afc90 2023-11-24T06:13:52.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.442+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28e40b51c0 con 0x7f28e40afc90 2023-11-24T06:13:52.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.442+0000 7f28da7fc700 1 -- 172.21.15.106:0/4220674019 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28e00544f0 con 0x7f28e40afc90 2023-11-24T06:13:52.445 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:13:52.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 msgr2=0x7f28c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 0x7f28c806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f28e40d0050 tx=0x7f28d4013040 comp rx=0 tx=0).stop 2023-11-24T06:13:52.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 msgr2=0x7f28e40c6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f28e000c4d0 tx=0x7f28e000c890 comp rx=0 tx=0).stop 2023-11-24T06:13:52.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 shutdown_connections 2023-11-24T06:13:52.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28c806aed0 0x7f28c806d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28e415e160 0x7f28e40c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28e40746a0 0x7f28e4148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 --2- 172.21.15.106:0/4220674019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28e40afc90 0x7f28e40c6e40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.444+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 >> 172.21.15.106:0/4220674019 conn(0x7f28e40d0bf0 msgr2=0x7f28e415d6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.445+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 shutdown_connections 2023-11-24T06:13:52.449 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.445+0000 7f28ebf45700 1 -- 172.21.15.106:0/4220674019 wait complete. 2023-11-24T06:13:52.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:52.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.578+0000 7f28f9f42700 1 Processor -- start 2023-11-24T06:13:52.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.578+0000 7f28f9f42700 1 -- start start 2023-11-24T06:13:52.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f9f42700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f28f415a620 0x7f28f40ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f9f42700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28f40cc540 0x7f28f406e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f9f42700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f406ef50 con 0x7f28f406eb20 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f9f42700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40b2f20 con 0x7f28f40cc540 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f9f42700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40ce690 con 0x7f28f415a620 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f2ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28f40cc540 0x7f28f406e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f2ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f28f40cc540 0x7f28f406e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58294/0 (socket says 172.21.15.106:58294) 2023-11-24T06:13:52.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f2ffd700 1 -- 172.21.15.106:0/4139572658 learned_addr learned my addr 172.21.15.106:0/4139572658 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.579+0000 7f28f37fe700 1 --2- 172.21.15.106:0/4139572658 >> v2:172.21.15.176:3300/0 conn(0x7f28f415a620 0x7f28f40ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f2ffd700 1 -- 172.21.15.106:0/4139572658 >> v2:172.21.15.176:3300/0 conn(0x7f28f415a620 msgr2=0x7f28f40ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f2ffd700 1 --2- 172.21.15.106:0/4139572658 >> v2:172.21.15.176:3300/0 conn(0x7f28f415a620 0x7f28f40ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f2ffd700 1 -- 172.21.15.106:0/4139572658 >> v1:172.21.15.176:6789/0 conn(0x7f28f406eb20 legacy=0x7f28f406d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f2ffd700 1 -- 172.21.15.106:0/4139572658 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f415aa00 con 0x7f28f40cc540 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f2ffd700 1 --2- 172.21.15.106:0/4139572658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f40cc540 0x7f28f406e5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28f4072800 tx=0x7f28e4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4489c2df4e8bbe5c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f27fc700 1 -- 172.21.15.106:0/4139572658 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4004230 con 0x7f28f40cc540 2023-11-24T06:13:52.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f27fc700 1 -- 172.21.15.106:0/4139572658 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4004390 con 0x7f28f40cc540 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f27fc700 1 -- 172.21.15.106:0/4139572658 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40036a0 con 0x7f28f40cc540 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 -- 172.21.15.106:0/4139572658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f40cc540 msgr2=0x7f28f406e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 --2- 172.21.15.106:0/4139572658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f40cc540 0x7f28f406e5e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f28f4072800 tx=0x7f28e4009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 -- 172.21.15.106:0/4139572658 shutdown_connections 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 --2- 172.21.15.106:0/4139572658 >> v2:172.21.15.176:3300/0 conn(0x7f28f415a620 0x7f28f40ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 --2- 172.21.15.106:0/4139572658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f40cc540 0x7f28f406e5e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 -- 172.21.15.106:0/4139572658 >> 172.21.15.106:0/4139572658 conn(0x7f28f40b2050 msgr2=0x7f28f40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.580+0000 7f28f9f42700 1 -- 172.21.15.106:0/4139572658 shutdown_connections 2023-11-24T06:13:52.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.581+0000 7f28f9f42700 1 -- 172.21.15.106:0/4139572658 wait complete. 2023-11-24T06:13:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.582+0000 7f28f9f42700 1 Processor -- start 2023-11-24T06:13:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.582+0000 7f28f9f42700 1 -- start start 2023-11-24T06:13:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28f406eb20 0x7f28f41433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28f40cc540 0x7f28f41407f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4141be0 con 0x7f28f415a620 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4140d30 con 0x7f28f40cc540 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f9f42700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4140f60 con 0x7f28f406eb20 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58300/0 (socket says 172.21.15.106:58300) 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f3fff700 1 -- 172.21.15.106:0/1425414308 learned_addr learned my addr 172.21.15.106:0/1425414308 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f2ffd700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28f40cc540 0x7f28f41407f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f37fe700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28f406eb20 0x7f28f41433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f3fff700 1 -- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28f406eb20 msgr2=0x7f28f41433e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.583+0000 7f28f3fff700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28f406eb20 0x7f28f41433e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f3fff700 1 -- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28f40cc540 msgr2=0x7f28f41407f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f3fff700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28f40cc540 0x7f28f41407f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f3fff700 1 -- 172.21.15.106:0/1425414308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4009550 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f3fff700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00cc40 tx=0x7f28ec00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00aba0 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec00ad00 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f4141240 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec012660 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.584+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f4141800 con 0x7f28f415a620 2023-11-24T06:13:52.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.585+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f4068d90 con 0x7f28f415a620 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.585+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28ec0127c0 con 0x7f28f415a620 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.586+0000 7f28dbfff700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 0x7f28e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.586+0000 7f28f37fe700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 0x7f28e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.586+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28ec089dc0 con 0x7f28f415a620 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.586+0000 7f28f37fe700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 0x7f28e006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28e800b9b0 tx=0x7f28e8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.590+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28ec054e80 con 0x7f28f415a620 2023-11-24T06:13:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.781+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f28f4068fb0 con 0x7f28f415a620 2023-11-24T06:13:52.784 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.782+0000 7f28dbfff700 1 -- 172.21.15.106:0/1425414308 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f28ec016020 con 0x7f28f415a620 2023-11-24T06:13:52.785 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:13:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 msgr2=0x7f28e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 0x7f28e006d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28e800b9b0 tx=0x7f28e8008040 comp rx=0 tx=0).stop 2023-11-24T06:13:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 msgr2=0x7f28f4142000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00cc40 tx=0x7f28ec00a060 comp rx=0 tx=0).stop 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 shutdown_connections 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f28e006aed0 0x7f28e006d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f28f415a620 0x7f28f4142000 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f28f406eb20 0x7f28f41433e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 --2- 172.21.15.106:0/1425414308 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f28f40cc540 0x7f28f41407f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 >> 172.21.15.106:0/1425414308 conn(0x7f28f40b2050 msgr2=0x7f28f406d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 shutdown_connections 2023-11-24T06:13:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.784+0000 7f28f9f42700 1 -- 172.21.15.106:0/1425414308 wait complete. 2023-11-24T06:13:52.799 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:52.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.917+0000 7f8930f80700 1 Processor -- start 2023-11-24T06:13:52.919 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.917+0000 7f8930f80700 1 -- start start 2023-11-24T06:13:52.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 0x7f892c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f892c0af4d0 0x7f892c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c06c000 0x7f892c06c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c0af0b0 con 0x7f892c0af4d0 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892c06c9f0 con 0x7f892c15e080 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8930f80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c0b05a0 con 0x7f892c06c000 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f892c0af4d0 0x7f892c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f892c0af4d0 0x7f892c0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58308/0 (socket says 172.21.15.106:58308) 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 -- 172.21.15.106:0/2736223855 learned_addr learned my addr 172.21.15.106:0/2736223855 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892a59c700 1 --2- 172.21.15.106:0/2736223855 >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 0x7f892c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892ad9d700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c06c000 0x7f892c06c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 -- 172.21.15.106:0/2736223855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c06c000 msgr2=0x7f892c06c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c06c000 0x7f892c06c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 -- 172.21.15.106:0/2736223855 >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 msgr2=0x7f892c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 --2- 172.21.15.106:0/2736223855 >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 0x7f892c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 -- 172.21.15.106:0/2736223855 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0ae430 con 0x7f892c0af4d0 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892a59c700 1 --2- 172.21.15.106:0/2736223855 >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 0x7f892c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f8929d9b700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c0af4d0 0x7f892c0afb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f892c072a90 tx=0x7f8920009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9963bc9be05ac1fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892959a700 1 -- 172.21.15.106:0/2736223855 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000b870 con 0x7f892c0af4d0 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892959a700 1 -- 172.21.15.106:0/2736223855 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000b9d0 con 0x7f892c0af4d0 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.918+0000 7f892959a700 1 -- 172.21.15.106:0/2736223855 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000bd60 con 0x7f892c0af4d0 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 -- 172.21.15.106:0/2736223855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c0af4d0 msgr2=0x7f892c0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c0af4d0 0x7f892c0afb90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f892c072a90 tx=0x7f8920009bd0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 -- 172.21.15.106:0/2736223855 shutdown_connections 2023-11-24T06:13:52.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c06c000 0x7f892c06c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 --2- 172.21.15.106:0/2736223855 >> v2:172.21.15.176:3300/0 conn(0x7f892c15e080 0x7f892c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 --2- 172.21.15.106:0/2736223855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c0af4d0 0x7f892c0afb90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 -- 172.21.15.106:0/2736223855 >> 172.21.15.106:0/2736223855 conn(0x7f892c071b90 msgr2=0x7f892c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:52.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 -- 172.21.15.106:0/2736223855 shutdown_connections 2023-11-24T06:13:52.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.919+0000 7f8930f80700 1 -- 172.21.15.106:0/2736223855 wait complete. 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.920+0000 7f8930f80700 1 Processor -- start 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.920+0000 7f8930f80700 1 -- start start 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 0x7f892c1493c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c0af4d0 0x7f892c158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c158470 con 0x7f892c15e080 2023-11-24T06:13:52.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892c15f080 con 0x7f892c06c000 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8930f80700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892c15fc00 con 0x7f892c0af4d0 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58316/0 (socket says 172.21.15.106:58316) 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 -- 172.21.15.106:0/94060289 learned_addr learned my addr 172.21.15.106:0/94060289 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892a59c700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 0x7f892c1493c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f8929d9b700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c0af4d0 0x7f892c158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 -- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c0af4d0 msgr2=0x7f892c158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c0af4d0 0x7f892c158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 -- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 msgr2=0x7f892c1493c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 0x7f892c1493c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:52.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892ad9d700 1 -- 172.21.15.106:0/94060289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8920009550 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.921+0000 7f892a59c700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 0x7f892c1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f892ad9d700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8924007e60 tx=0x7f892400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892400ede0 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8924014420 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892c15f2d0 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89240147d0 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.922+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f892c15f890 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.923+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892c0753f0 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.923+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8924014930 con 0x7f892c15e080 2023-11-24T06:13:52.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.923+0000 7f891affd700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 0x7f890c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:52.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.924+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8924089cf0 con 0x7f892c15e080 2023-11-24T06:13:52.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.924+0000 7f892a59c700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 0x7f890c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:52.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.924+0000 7f892a59c700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 0x7f890c06d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f891c009960 tx=0x7f891c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:52.931 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:52.928+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f892408e070 con 0x7f892c15e080 2023-11-24T06:13:53.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.160+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f892c0d09b0 con 0x7f892c15e080 2023-11-24T06:13:53.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.160+0000 7f891affd700 1 -- 172.21.15.106:0/94060289 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f8924054db0 con 0x7f892c15e080 2023-11-24T06:13:53.163 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:53.163 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:53.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 msgr2=0x7f890c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 0x7f890c06d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f891c009960 tx=0x7f891c008040 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 msgr2=0x7f892c159520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f8924007e60 tx=0x7f892400e3c0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 shutdown_connections 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f890c06aed0 0x7f890c06d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f892c15e080 0x7f892c159520 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f892c06c000 0x7f892c1493c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 --2- 172.21.15.106:0/94060289 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f892c0af4d0 0x7f892c158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.162+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 >> 172.21.15.106:0/94060289 conn(0x7f892c071b90 msgr2=0x7f892c15d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.163+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 shutdown_connections 2023-11-24T06:13:53.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.163+0000 7f8930f80700 1 -- 172.21.15.106:0/94060289 wait complete. 2023-11-24T06:13:53.167 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:13:53.177 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:53.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.294+0000 7fa504460700 1 Processor -- start 2023-11-24T06:13:53.297 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.294+0000 7fa504460700 1 -- start start 2023-11-24T06:13:53.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa504460700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa504460700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 0x7fa4fc0d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.299 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa504460700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4fc0d2d10 con 0x7fa4fc0b2fc0 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa504460700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cefd0 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa504460700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cf2b0 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58320/0 (socket says 172.21.15.106:58320) 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 -- 172.21.15.106:0/2541195906 learned_addr learned my addr 172.21.15.106:0/2541195906 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5029fd700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 0x7fa4fc0d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 -- 172.21.15.106:0/2541195906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 msgr2=0x7fa4fc0d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:53.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 0x7fa4fc0d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 -- 172.21.15.106:0/2541195906 >> v1:172.21.15.176:6789/0 conn(0x7fa4fc0b2fc0 legacy=0x7fa4fc161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:53.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5021fc700 1 -- 172.21.15.106:0/2541195906 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc0d2fb0 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.295+0000 7fa5029fd700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 0x7fa4fc0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:53.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa5021fc700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098f0 tx=0x7fa4ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f143314f22d79d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa5011fa700 1 -- 172.21.15.106:0/2541195906 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec004230 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa5011fa700 1 -- 172.21.15.106:0/2541195906 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4ec004390 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa5011fa700 1 -- 172.21.15.106:0/2541195906 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4ec0036a0 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 -- 172.21.15.106:0/2541195906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc15dfc0 msgr2=0x7fa4fc0d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec0098f0 tx=0x7fa4ec009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 -- 172.21.15.106:0/2541195906 shutdown_connections 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0d44e0 0x7fa4fc0d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 --2- 172.21.15.106:0/2541195906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc0d0e60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 -- 172.21.15.106:0/2541195906 >> 172.21.15.106:0/2541195906 conn(0x7fa4fc06b410 msgr2=0x7fa4fc06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 -- 172.21.15.106:0/2541195906 shutdown_connections 2023-11-24T06:13:53.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.296+0000 7fa504460700 1 -- 172.21.15.106:0/2541195906 wait complete. 2023-11-24T06:13:53.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.297+0000 7fa504460700 1 Processor -- start 2023-11-24T06:13:53.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 -- start start 2023-11-24T06:13:53.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0b2fc0 0x7fa4fc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cb960 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc1587c0 con 0x7fa4fc15dfc0 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa504460700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4fc0cc910 con 0x7fa4fc0b2fc0 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa5019fb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa5019fb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58328/0 (socket says 172.21.15.106:58328) 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa5019fb700 1 -- 172.21.15.106:0/1067728844 learned_addr learned my addr 172.21.15.106:0/1067728844 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:53.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa5021fc700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0b2fc0 0x7fa4fc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.298+0000 7fa5029fd700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 -- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0b2fc0 msgr2=0x7fa4fc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0b2fc0 0x7fa4fc0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 -- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4fc15dfc0 msgr2=0x7fa4fc158280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc158280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 -- 172.21.15.106:0/1067728844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009550 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa5019fb700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800b450 tx=0x7fa4f800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011830 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.307 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8011990 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc0cbb50 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8011d40 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.299+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4fc0cc110 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.300+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4fc0cc760 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.300+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4f801a400 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.301+0000 7fa4f2ffd700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 0x7fa4e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.301+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4f8089260 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.301+0000 7fa5021fc700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 0x7fa4e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.301+0000 7fa5021fc700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 0x7fa4e006d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009130 tx=0x7fa4ec008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.309 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.305+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4f80543a0 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.494+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4fc067f60 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.495+0000 7fa4f2ffd700 1 -- 172.21.15.106:0/1067728844 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fa4f80579c0 con 0x7fa4fc0d44e0 2023-11-24T06:13:53.498 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:53.498 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 msgr2=0x7fa4e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 0x7fa4e006d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec009130 tx=0x7fa4ec008030 comp rx=0 tx=0).stop 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 msgr2=0x7fa4fc0c9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800b450 tx=0x7fa4f800b810 comp rx=0 tx=0).stop 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 shutdown_connections 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa4e006aed0 0x7fa4e006d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4fc15dfc0 0x7fa4fc158280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4fc0b2fc0 0x7fa4fc0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 --2- 172.21.15.106:0/1067728844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4fc0d44e0 0x7fa4fc0c9510 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 >> 172.21.15.106:0/1067728844 conn(0x7fa4fc06b410 msgr2=0x7fa4fc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 shutdown_connections 2023-11-24T06:13:53.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.497+0000 7fa504460700 1 -- 172.21.15.106:0/1067728844 wait complete. 2023-11-24T06:13:53.512 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:13:53.513 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:13:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.633+0000 7fcb07bc4700 1 Processor -- start 2023-11-24T06:13:53.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.634+0000 7fcb07bc4700 1 -- start start 2023-11-24T06:13:53.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb07bc4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcb000746a0 0x7fcb000b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb07bc4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb000afc90 0x7fcb0006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb07bc4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb000b3c60 con 0x7fcb0015e160 2023-11-24T06:13:53.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb07bc4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb000b4500 con 0x7fcb000afc90 2023-11-24T06:13:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb07bc4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb000b58c0 con 0x7fcb000746a0 2023-11-24T06:13:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb000afc90 0x7fcb0006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb05960700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcb0015e160 0x7fcb00073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38596/0 (socket says 172.21.15.106:38596) 2023-11-24T06:13:53.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb05960700 1 -- 172.21.15.106:0/2025447194 learned_addr learned my addr 172.21.15.106:0/2025447194 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb0515f700 1 --2- 172.21.15.106:0/2025447194 >> v2:172.21.15.176:3300/0 conn(0x7fcb000746a0 0x7fcb000b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 -- 172.21.15.106:0/2025447194 >> v2:172.21.15.176:3300/0 conn(0x7fcb000746a0 msgr2=0x7fcb000b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 --2- 172.21.15.106:0/2025447194 >> v2:172.21.15.176:3300/0 conn(0x7fcb000746a0 0x7fcb000b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 -- 172.21.15.106:0/2025447194 >> v1:172.21.15.106:6789/0 conn(0x7fcb0015e160 legacy=0x7fcb00073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 -- 172.21.15.106:0/2025447194 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0006bdc0 con 0x7fcb000afc90 2023-11-24T06:13:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb0495e700 1 -- 172.21.15.106:0/2025447194 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365331719 0 0) 0x7fcb000b3c60 con 0x7fcb0015e160 2023-11-24T06:13:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb06161700 1 --2- 172.21.15.106:0/2025447194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000afc90 0x7fcb0006d930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb000d0880 tx=0x7fcaf800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98eabe2e536485 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb0495e700 1 -- 172.21.15.106:0/2025447194 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800e070 con 0x7fcb000afc90 2023-11-24T06:13:53.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb0495e700 1 -- 172.21.15.106:0/2025447194 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800bbd0 con 0x7fcb000afc90 2023-11-24T06:13:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.635+0000 7fcb0495e700 1 -- 172.21.15.106:0/2025447194 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8012430 con 0x7fcb000afc90 2023-11-24T06:13:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 -- 172.21.15.106:0/2025447194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000afc90 msgr2=0x7fcb0006d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/2025447194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000afc90 0x7fcb0006d930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcb000d0880 tx=0x7fcaf800b330 comp rx=0 tx=0).stop 2023-11-24T06:13:53.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 -- 172.21.15.106:0/2025447194 shutdown_connections 2023-11-24T06:13:53.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/2025447194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000afc90 0x7fcb0006d930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/2025447194 >> v2:172.21.15.176:3300/0 conn(0x7fcb000746a0 0x7fcb000b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 -- 172.21.15.106:0/2025447194 >> 172.21.15.106:0/2025447194 conn(0x7fcb000d0bf0 msgr2=0x7fcb000d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 -- 172.21.15.106:0/2025447194 shutdown_connections 2023-11-24T06:13:53.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.636+0000 7fcb07bc4700 1 -- 172.21.15.106:0/2025447194 wait complete. 2023-11-24T06:13:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.637+0000 7fcb07bc4700 1 Processor -- start 2023-11-24T06:13:53.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.637+0000 7fcb07bc4700 1 -- start start 2023-11-24T06:13:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 0x7fcb001601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0015e160 0x7fcb001f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb001608b0 con 0x7fcb000746a0 2023-11-24T06:13:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00160b90 con 0x7fcb000afc90 2023-11-24T06:13:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb07bc4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb00160e70 con 0x7fcb0015e160 2023-11-24T06:13:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58340/0 (socket says 172.21.15.106:58340) 2023-11-24T06:13:53.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 -- 172.21.15.106:0/739979929 learned_addr learned my addr 172.21.15.106:0/739979929 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb06161700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0015e160 0x7fcb001f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb0515f700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 0x7fcb001601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 -- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0015e160 msgr2=0x7fcb001f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0015e160 0x7fcb001f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 -- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 msgr2=0x7fcb001601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 0x7fcb001601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 -- 172.21.15.106:0/739979929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8009a70 con 0x7fcb000746a0 2023-11-24T06:13:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb0515f700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 0x7fcb001601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:53.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcb05960700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c550 tx=0x7fcaf000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0004c80 con 0x7fcb000746a0 2023-11-24T06:13:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.638+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf0004e00 con 0x7fcb000746a0 2023-11-24T06:13:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.639+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf0007310 con 0x7fcb000746a0 2023-11-24T06:13:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.639+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb00161150 con 0x7fcb000746a0 2023-11-24T06:13:53.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.639+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb001f3910 con 0x7fcb000746a0 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.639+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb00153100 con 0x7fcb000746a0 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.640+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcaf0007470 con 0x7fcb000746a0 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.640+0000 7fcaf67fc700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 0x7fcae406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.640+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaf00891f0 con 0x7fcb000746a0 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.640+0000 7fcb0515f700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 0x7fcae406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.641+0000 7fcb0515f700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 0x7fcae406d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb00148670 tx=0x7fcafc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.645+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcaf0054330 con 0x7fcb000746a0 2023-11-24T06:13:53.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.836+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb00068fb0 con 0x7fcb000746a0 2023-11-24T06:13:53.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.836+0000 7fcaf67fc700 1 -- 172.21.15.106:0/739979929 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcaf0057950 con 0x7fcb000746a0 2023-11-24T06:13:53.839 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:13:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 msgr2=0x7fcae406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 0x7fcae406d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcb00148670 tx=0x7fcafc008040 comp rx=0 tx=0).stop 2023-11-24T06:13:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 msgr2=0x7fcb000b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcaf000c550 tx=0x7fcaf000c860 comp rx=0 tx=0).stop 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 shutdown_connections 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcae406aed0 0x7fcae406d390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcb0015e160 0x7fcb001f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb000746a0 0x7fcb000b0d20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 --2- 172.21.15.106:0/739979929 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcb000afc90 0x7fcb001601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 >> 172.21.15.106:0/739979929 conn(0x7fcb000d0bf0 msgr2=0x7fcb000b1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 shutdown_connections 2023-11-24T06:13:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.838+0000 7fcb07bc4700 1 -- 172.21.15.106:0/739979929 wait complete. 2023-11-24T06:13:53.853 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:13:53.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.972+0000 7f1736858700 1 Processor -- start 2023-11-24T06:13:53.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.972+0000 7f1736858700 1 -- start start 2023-11-24T06:13:53.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1736858700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f173006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1736858700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17300b3250 0x7f173006b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1736858700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17300b6fb0 con 0x7f173015e320 2023-11-24T06:13:53.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1736858700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17300d4da0 con 0x7f17300b3250 2023-11-24T06:13:53.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1736858700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17300d2c10 con 0x7f17300b93c0 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17300b3250 0x7f173006b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172ffff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f173015e320 0x7f17300d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38610/0 (socket says 172.21.15.106:38610) 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172ffff700 1 -- 172.21.15.106:0/1660221079 learned_addr learned my addr 172.21.15.106:0/1660221079 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172f7fe700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f173006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 -- 172.21.15.106:0/1660221079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 msgr2=0x7f173006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f173006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 -- 172.21.15.106:0/1660221079 >> v1:172.21.15.106:6789/0 conn(0x7f173015e320 legacy=0x7f17300d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 -- 172.21.15.106:0/1660221079 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17300d2ef0 con 0x7f17300b3250 2023-11-24T06:13:53.978 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172effd700 1 -- 172.21.15.106:0/1660221079 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096514660 0 0) 0x7f17300b6fb0 con 0x7f173015e320 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f1734df5700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17300b3250 0x7f173006b530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1728009d90 tx=0x7f172800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3639fb0fd83c7d8c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172effd700 1 -- 172.21.15.106:0/1660221079 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172800e070 con 0x7f17300b3250 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172effd700 1 -- 172.21.15.106:0/1660221079 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172800bbd0 con 0x7f17300b3250 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.973+0000 7f172effd700 1 -- 172.21.15.106:0/1660221079 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728012430 con 0x7f17300b3250 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 -- 172.21.15.106:0/1660221079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17300b3250 msgr2=0x7f173006b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17300b3250 0x7f173006b530 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1728009d90 tx=0x7f172800b330 comp rx=0 tx=0).stop 2023-11-24T06:13:53.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 -- 172.21.15.106:0/1660221079 shutdown_connections 2023-11-24T06:13:53.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17300b3250 0x7f173006b530 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 --2- 172.21.15.106:0/1660221079 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f173006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 -- 172.21.15.106:0/1660221079 >> 172.21.15.106:0/1660221079 conn(0x7f17300d3e50 msgr2=0x7f17300d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:53.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 -- 172.21.15.106:0/1660221079 shutdown_connections 2023-11-24T06:13:53.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.974+0000 7f1736858700 1 -- 172.21.15.106:0/1660221079 wait complete. 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.975+0000 7f1736858700 1 Processor -- start 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.975+0000 7f1736858700 1 -- start start 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 0x7f1730158c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f1730158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730159340 con 0x7f173015e320 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1730159620 con 0x7f17300b3250 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1736858700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1730159900 con 0x7f17300b93c0 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58358/0 (socket says 172.21.15.106:58358) 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 -- 172.21.15.106:0/330667481 learned_addr learned my addr 172.21.15.106:0/330667481 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f172ffff700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 0x7f1730158c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 -- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 msgr2=0x7f1730158580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f1730158580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 -- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 msgr2=0x7f1730158c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 0x7f1730158c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f1734df5700 1 -- 172.21.15.106:0/330667481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728009a70 con 0x7f173015e320 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.976+0000 7f172ffff700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 0x7f1730158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f1734df5700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1730074c90 tx=0x7f1728004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728012430 con 0x7f173015e320 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1728020070 con 0x7f173015e320 2023-11-24T06:13:53.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1728004280 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1730159be0 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.977+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173015b520 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.978+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17300cfc10 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.978+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17280043e0 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.979+0000 7f172cff9700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 0x7f171c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.979+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1728022070 con 0x7f173015e320 2023-11-24T06:13:53.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.979+0000 7f172ffff700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 0x7f171c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:53.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.979+0000 7f172ffff700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 0x7f171c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:53.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:53.983+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1728056540 con 0x7f173015e320 2023-11-24T06:13:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.176+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f173015a100 con 0x7f173015e320 2023-11-24T06:13:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.176+0000 7f172cff9700 1 -- 172.21.15.106:0/330667481 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f173015a100 con 0x7f173015e320 2023-11-24T06:13:54.179 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:13:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 msgr2=0x7f171c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 0x7f171c06d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1724000f60 tx=0x7f1724007d30 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 msgr2=0x7f173015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1730074c90 tx=0x7f1728004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 shutdown_connections 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f171c06aed0 0x7f171c06d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f173015e320 0x7f173015afe0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f17300b3250 0x7f1730158c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 --2- 172.21.15.106:0/330667481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f17300b93c0 0x7f1730158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.178+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 >> 172.21.15.106:0/330667481 conn(0x7f17300d3e50 msgr2=0x7f17300b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.179+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 shutdown_connections 2023-11-24T06:13:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.179+0000 7f1736858700 1 -- 172.21.15.106:0/330667481 wait complete. 2023-11-24T06:13:54.193 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:13:54.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.314+0000 7f5b45e47700 1 Processor -- start 2023-11-24T06:13:54.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.314+0000 7f5b45e47700 1 -- start start 2023-11-24T06:13:54.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b45e47700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5b400cfdf0 0x7f5b40073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b45e47700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b400b5ee0 con 0x7f5b4015be70 2023-11-24T06:13:54.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b45e47700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4006ba00 con 0x7f5b400744d0 2023-11-24T06:13:54.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b45e47700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4006bfc0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b3effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5b400cfdf0 0x7f5b40073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b3f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5b4015be70 0x7f5b400add40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38624/0 (socket says 172.21.15.106:38624) 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.315+0000 7f5b3f7fe700 1 -- 172.21.15.106:0/497217156 learned_addr learned my addr 172.21.15.106:0/497217156 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3effd700 1 -- 172.21.15.106:0/497217156 >> v1:172.21.15.176:6789/0 conn(0x7f5b400744d0 legacy=0x7f5b400b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3effd700 1 -- 172.21.15.106:0/497217156 >> v1:172.21.15.106:6789/0 conn(0x7f5b4015be70 legacy=0x7f5b400add40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3effd700 1 -- 172.21.15.106:0/497217156 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b4006bce0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3e7fc700 1 -- 172.21.15.106:0/497217156 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602087615 0 0) 0x7f5b400b5ee0 con 0x7f5b4015be70 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3effd700 1 --2- 172.21.15.106:0/497217156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b40073f90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009840 tx=0x7f5b30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2c8a19238e7cab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3e7fc700 1 -- 172.21.15.106:0/497217156 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30011830 con 0x7f5b400cfdf0 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3e7fc700 1 -- 172.21.15.106:0/497217156 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b30011990 con 0x7f5b400cfdf0 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b3e7fc700 1 -- 172.21.15.106:0/497217156 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30011d20 con 0x7f5b400cfdf0 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 -- 172.21.15.106:0/497217156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 msgr2=0x7f5b40073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 --2- 172.21.15.106:0/497217156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b40073f90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009840 tx=0x7f5b30009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 -- 172.21.15.106:0/497217156 shutdown_connections 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 --2- 172.21.15.106:0/497217156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b40073f90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 -- 172.21.15.106:0/497217156 >> 172.21.15.106:0/497217156 conn(0x7f5b400d0bf0 msgr2=0x7f5b400d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.316+0000 7f5b45e47700 1 -- 172.21.15.106:0/497217156 shutdown_connections 2023-11-24T06:13:54.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.317+0000 7f5b45e47700 1 -- 172.21.15.106:0/497217156 wait complete. 2023-11-24T06:13:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.318+0000 7f5b45e47700 1 Processor -- start 2023-11-24T06:13:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.318+0000 7f5b45e47700 1 -- start start 2023-11-24T06:13:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 0x7f5b401f2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 0x7f5b4015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b401f3520 con 0x7f5b400cfdf0 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4006ddf0 con 0x7f5b4015be70 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4006e0d0 con 0x7f5b400744d0 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58370/0 (socket says 172.21.15.106:58370) 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 -- 172.21.15.106:0/2251893360 learned_addr learned my addr 172.21.15.106:0/2251893360 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3f7fe700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 0x7f5b401f2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3ffff700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 0x7f5b4015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 -- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 msgr2=0x7f5b401f2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 0x7f5b401f2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 -- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 msgr2=0x7f5b4015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 0x7f5b4015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 -- 172.21.15.106:0/2251893360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b300094a0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3f7fe700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 0x7f5b401f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3ffff700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 0x7f5b4015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:54.326 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b3effd700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b300090b0 tx=0x7f5b30004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3001a900 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b3001aa60 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3001add0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4006e3b0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.319+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4006e970 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.320+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b40068fb0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.321+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b30022070 con 0x7f5b400cfdf0 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.321+0000 7f5b27fff700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 0x7f5b2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.327 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.321+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b3008a780 con 0x7f5b400cfdf0 2023-11-24T06:13:54.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.321+0000 7f5b3f7fe700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 0x7f5b2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.321+0000 7f5b3f7fe700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 0x7f5b2c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f60 tx=0x7f5b34009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.325+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b30055970 con 0x7f5b400cfdf0 2023-11-24T06:13:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.514+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b4014fce0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.515+0000 7f5b27fff700 1 -- 172.21.15.106:0/2251893360 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b30006cc0 con 0x7f5b400cfdf0 2023-11-24T06:13:54.518 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 msgr2=0x7f5b2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 0x7f5b2c06d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5b34000f60 tx=0x7f5b34009040 comp rx=0 tx=0).stop 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 msgr2=0x7f5b4014f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5b300090b0 tx=0x7f5b30004750 comp rx=0 tx=0).stop 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 shutdown_connections 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b2c06aed0 0x7f5b2c06d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b4015be70 0x7f5b4015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b400744d0 0x7f5b401f2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 --2- 172.21.15.106:0/2251893360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b400cfdf0 0x7f5b4014f7a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 >> 172.21.15.106:0/2251893360 conn(0x7f5b400d0bf0 msgr2=0x7f5b40159bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 shutdown_connections 2023-11-24T06:13:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.517+0000 7f5b45e47700 1 -- 172.21.15.106:0/2251893360 wait complete. 2023-11-24T06:13:54.532 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:54.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.648+0000 7fd9cce5e700 1 Processor -- start 2023-11-24T06:13:54.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.648+0000 7fd9cce5e700 1 -- start start 2023-11-24T06:13:54.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9cce5e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd9c80af1e0 0x7fd9c80622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9cce5e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c815c540 con 0x7fd9c815c160 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9cce5e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9c80b2ee0 con 0x7fd9c80b04b0 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9cce5e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9c80add40 con 0x7fd9c80af1e0 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c659c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd9c815c160 0x7fd9c80afda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38638/0 (socket says 172.21.15.106:38638) 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c659c700 1 -- 172.21.15.106:0/3569061009 learned_addr learned my addr 172.21.15.106:0/3569061009 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c6d9d700 1 --2- 172.21.15.106:0/3569061009 >> v2:172.21.15.176:3300/0 conn(0x7fd9c80af1e0 0x7fd9c80622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233193662 0 0) 0x7fd9c815c540 con 0x7fd9c815c160 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9b00035b0 con 0x7fd9c815c160 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894654533 0 0) 0x7fd9b00035b0 con 0x7fd9c815c160 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 >> v2:172.21.15.176:3300/0 conn(0x7fd9c80af1e0 msgr2=0x7fd9c80622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 --2- 172.21.15.106:0/3569061009 >> v2:172.21.15.176:3300/0 conn(0x7fd9c80af1e0 0x7fd9c80622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 >> v1:172.21.15.176:6789/0 conn(0x7fd9c80b04b0 legacy=0x7fd9c8163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80ad410 con 0x7fd9c815c160 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.649+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fd9bc001670 con 0x7fd9c815c160 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 >> v1:172.21.15.106:6789/0 conn(0x7fd9c815c160 legacy=0x7fd9c80afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b0003a00 0x7fd9b0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b0004850 0x7fd9b0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9b000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80add40 con 0x7fd9b0005210 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000c0b0 con 0x7fd9b0003a00 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b000c270 con 0x7fd9b0004850 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9b000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c659c700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b0003a00 0x7fd9b0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c5d9b700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b0004850 0x7fd9b0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 -- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b0004850 msgr2=0x7fd9b0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9b0004850 0x7fd9b0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 -- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b0003a00 msgr2=0x7fd9b0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9b0003a00 0x7fd9b0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 -- 172.21.15.106:0/3569061009 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b00035b0 con 0x7fd9b0005210 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 -- 172.21.15.106:0/3569061009 reap_dead start 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c6d9d700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9b000ba10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fc0 tx=0x7fd9b0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a56253a31f61c44 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0003a20 con 0x7fd9b0005210 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000f040 con 0x7fd9b0005210 2023-11-24T06:13:54.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.650+0000 7fd9c559a700 1 -- 172.21.15.106:0/3569061009 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0003de0 con 0x7fd9b0005210 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 -- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 msgr2=0x7fd9b000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9b000ba10 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009fc0 tx=0x7fd9b0005880 comp rx=0 tx=0).stop 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 -- 172.21.15.106:0/3569061009 shutdown_connections 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/3569061009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9b000ba10 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 -- 172.21.15.106:0/3569061009 >> 172.21.15.106:0/3569061009 conn(0x7fd9c80b57b0 msgr2=0x7fd9c80b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 -- 172.21.15.106:0/3569061009 shutdown_connections 2023-11-24T06:13:54.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.651+0000 7fd9cce5e700 1 -- 172.21.15.106:0/3569061009 wait complete. 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.652+0000 7fd9cce5e700 1 Processor -- start 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 -- start start 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c815eb90 0x7fd9c80c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80c9b50 0x7fd9c80b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c815cca0 con 0x7fd9b0005210 2023-11-24T06:13:54.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80c9fd0 con 0x7fd9c80c9b50 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.653+0000 7fd9cce5e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9c80b4f10 con 0x7fd9c815eb90 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58386/0 (socket says 172.21.15.106:58386) 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 -- 172.21.15.106:0/4142304128 learned_addr learned my addr 172.21.15.106:0/4142304128 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c5d9b700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c815eb90 0x7fd9c80c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 -- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c815eb90 msgr2=0x7fd9c80c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c815eb90 0x7fd9c80c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 -- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80c9b50 msgr2=0x7fd9c80b3390 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80c9b50 0x7fd9c80b3390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 -- 172.21.15.106:0/4142304128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80b3f70 con 0x7fd9b0005210 2023-11-24T06:13:54.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9c659c700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0072c0 tx=0x7fd9bc0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011580 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9bc011720 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9bc011ad0 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c80b4250 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.654+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9c815c8c0 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.655+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9c8067f60 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.655+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9bc011c30 con 0x7fd9b0005210 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.656+0000 7fd9b6ffd700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 0x7fd9a806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:54.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.656+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9bc089500 con 0x7fd9b0005210 2023-11-24T06:13:54.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.656+0000 7fd9c5d9b700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 0x7fd9a806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:54.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.656+0000 7fd9c5d9b700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 0x7fd9a806d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80ca3e0 tx=0x7fd9b8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:54.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.660+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9bc0546f0 con 0x7fd9b0005210 2023-11-24T06:13:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.893+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9c815cde0 con 0x7fd9b0005210 2023-11-24T06:13:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.893+0000 7fd9b6ffd700 1 -- 172.21.15.106:0/4142304128 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd9c815cde0 con 0x7fd9b0005210 2023-11-24T06:13:54.896 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:54.896 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 msgr2=0x7fd9a806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 0x7fd9a806d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80ca3e0 tx=0x7fd9b8009040 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 msgr2=0x7fd9c81f4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc0072c0 tx=0x7fd9bc0075d0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 shutdown_connections 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd9a806aed0 0x7fd9a806d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd9c80c9b50 0x7fd9c80b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9b0005210 0x7fd9c81f4770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 --2- 172.21.15.106:0/4142304128 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd9c815eb90 0x7fd9c80c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.895+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 >> 172.21.15.106:0/4142304128 conn(0x7fd9c80b57b0 msgr2=0x7fd9c80ce720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.896+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 shutdown_connections 2023-11-24T06:13:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:54.896+0000 7fd9cce5e700 1 -- 172.21.15.106:0/4142304128 wait complete. 2023-11-24T06:13:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:13:54.910 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:13:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.028+0000 7fc76fd85700 1 Processor -- start 2023-11-24T06:13:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.028+0000 7fc76fd85700 1 -- start start 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76fd85700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc7680adf00 0x7fc76806c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76fd85700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680af950 con 0x7fc76806c540 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76fd85700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7680afc30 con 0x7fc7681446a0 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76fd85700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76806c9f0 con 0x7fc7680adf00 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76d320700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc7680adf00 0x7fc76806c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76e322700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc76806c540 0x7fc7680b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38660/0 (socket says 172.21.15.106:38660) 2023-11-24T06:13:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76e322700 1 -- 172.21.15.106:0/4138058453 learned_addr learned my addr 172.21.15.106:0/4138058453 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76d320700 1 -- 172.21.15.106:0/4138058453 >> v1:172.21.15.176:6789/0 conn(0x7fc7681446a0 legacy=0x7fc7680b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76d320700 1 -- 172.21.15.106:0/4138058453 >> v1:172.21.15.106:6789/0 conn(0x7fc76806c540 legacy=0x7fc7680b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76d320700 1 -- 172.21.15.106:0/4138058453 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7680aff10 con 0x7fc7680adf00 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76cb1f700 1 -- 172.21.15.106:0/4138058453 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344384760 0 0) 0x7fc7680af950 con 0x7fc76806c540 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76d320700 1 --2- 172.21.15.106:0/4138058453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7680adf00 0x7fc76806c000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc764009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9031b4ef9df73b2e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76cb1f700 1 -- 172.21.15.106:0/4138058453 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764011830 con 0x7fc7680adf00 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76cb1f700 1 -- 172.21.15.106:0/4138058453 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764011990 con 0x7fc7680adf00 2023-11-24T06:13:55.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.029+0000 7fc76cb1f700 1 -- 172.21.15.106:0/4138058453 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764011d20 con 0x7fc7680adf00 2023-11-24T06:13:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 -- 172.21.15.106:0/4138058453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7680adf00 msgr2=0x7fc76806c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 --2- 172.21.15.106:0/4138058453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7680adf00 0x7fc76806c000 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc764009b50 comp rx=0 tx=0).stop 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 -- 172.21.15.106:0/4138058453 shutdown_connections 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 --2- 172.21.15.106:0/4138058453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7680adf00 0x7fc76806c000 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 -- 172.21.15.106:0/4138058453 >> 172.21.15.106:0/4138058453 conn(0x7fc768071b90 msgr2=0x7fc768071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 -- 172.21.15.106:0/4138058453 shutdown_connections 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.030+0000 7fc76fd85700 1 -- 172.21.15.106:0/4138058453 wait complete. 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.031+0000 7fc76fd85700 1 Processor -- start 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.031+0000 7fc76fd85700 1 -- start start 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 0x7fc7680cf750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 0x7fc7680cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc768156dc0 con 0x7fc76806c540 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7681ef3d0 con 0x7fc7680adf00 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc768157780 con 0x7fc7681446a0 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58400/0 (socket says 172.21.15.106:58400) 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 -- 172.21.15.106:0/803437624 learned_addr learned my addr 172.21.15.106:0/803437624 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76d320700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 0x7fc7680cf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76e322700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 0x7fc7680cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 -- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 msgr2=0x7fc7680cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 0x7fc7680cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 -- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 msgr2=0x7fc7680cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 0x7fc7680cf750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 -- 172.21.15.106:0/803437624 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640094a0 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76d320700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 0x7fc7680cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76e322700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 0x7fc7680cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76db21700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c450 tx=0x7fc75800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580052d0 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc758005430 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7580038c0 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.032+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc768157a60 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.033+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc768158020 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.033+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7680753f0 con 0x7fc76806c540 2023-11-24T06:13:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.034+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc758003a20 con 0x7fc76806c540 2023-11-24T06:13:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.034+0000 7fc75e7fc700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 0x7fc74c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.035+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7580889d0 con 0x7fc76806c540 2023-11-24T06:13:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.035+0000 7fc76d320700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 0x7fc74c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.035+0000 7fc76d320700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 0x7fc74c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc76401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.039+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7580539e0 con 0x7fc76806c540 2023-11-24T06:13:55.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.236+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc768067f60 con 0x7fc76806c540 2023-11-24T06:13:55.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.237+0000 7fc75e7fc700 1 -- 172.21.15.106:0/803437624 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fc758057000 con 0x7fc76806c540 2023-11-24T06:13:55.240 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:55.240 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:13:55.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 msgr2=0x7fc74c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 0x7fc74c06d390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc764009840 tx=0x7fc76401c040 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 msgr2=0x7fc768156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc75800c450 tx=0x7fc75800c810 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 shutdown_connections 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc74c06aed0 0x7fc74c06d390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc7681446a0 0x7fc7680cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc76806c540 0x7fc768156f30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 --2- 172.21.15.106:0/803437624 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc7680adf00 0x7fc7680cf750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 >> 172.21.15.106:0/803437624 conn(0x7fc768071b90 msgr2=0x7fc76806e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 shutdown_connections 2023-11-24T06:13:55.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.239+0000 7fc76fd85700 1 -- 172.21.15.106:0/803437624 wait complete. 2023-11-24T06:13:55.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:13:55.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.371+0000 7ff845d16700 1 Processor -- start 2023-11-24T06:13:55.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.371+0000 7ff845d16700 1 -- start start 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff845d16700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff840158a50 0x7ff8400c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff845d16700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff840162a30 0x7ff8400c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff845d16700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8400cfff0 con 0x7ff840158670 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff845d16700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400629b0 con 0x7ff840162a30 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff845d16700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8400cfd10 con 0x7ff840158a50 2023-11-24T06:13:55.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff83ffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff840162a30 0x7ff8400c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff83ffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff840162a30 0x7ff8400c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58412/0 (socket says 172.21.15.106:58412) 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.372+0000 7ff83ffff700 1 -- 172.21.15.106:0/3347100976 learned_addr learned my addr 172.21.15.106:0/3347100976 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83ffff700 1 -- 172.21.15.106:0/3347100976 >> v2:172.21.15.176:3300/0 conn(0x7ff840158a50 msgr2=0x7ff8400c98b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83ffff700 1 --2- 172.21.15.106:0/3347100976 >> v2:172.21.15.176:3300/0 conn(0x7ff840158a50 0x7ff8400c98b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83ffff700 1 -- 172.21.15.106:0/3347100976 >> v1:172.21.15.176:6789/0 conn(0x7ff840158670 legacy=0x7ff8400622a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83ffff700 1 -- 172.21.15.106:0/3347100976 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff840161f50 con 0x7ff840162a30 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83ffff700 1 --2- 172.21.15.106:0/3347100976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff8400c9df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff8400ca730 tx=0x7ff83800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=873379386beb4a0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83e7fc700 1 -- 172.21.15.106:0/3347100976 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff83800e070 con 0x7ff840162a30 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83e7fc700 1 -- 172.21.15.106:0/3347100976 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff838003a20 con 0x7ff840162a30 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff83e7fc700 1 -- 172.21.15.106:0/3347100976 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838003dd0 con 0x7ff840162a30 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 -- 172.21.15.106:0/3347100976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 msgr2=0x7ff8400c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 --2- 172.21.15.106:0/3347100976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff8400c9df0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff8400ca730 tx=0x7ff83800b330 comp rx=0 tx=0).stop 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 -- 172.21.15.106:0/3347100976 shutdown_connections 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 --2- 172.21.15.106:0/3347100976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff8400c9df0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 --2- 172.21.15.106:0/3347100976 >> v2:172.21.15.176:3300/0 conn(0x7ff840158a50 0x7ff8400c98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 -- 172.21.15.106:0/3347100976 >> 172.21.15.106:0/3347100976 conn(0x7ff8400b57b0 msgr2=0x7ff8400b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 -- 172.21.15.106:0/3347100976 shutdown_connections 2023-11-24T06:13:55.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.373+0000 7ff845d16700 1 -- 172.21.15.106:0/3347100976 wait complete. 2023-11-24T06:13:55.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.375+0000 7ff845d16700 1 Processor -- start 2023-11-24T06:13:55.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.375+0000 7ff845d16700 1 -- start start 2023-11-24T06:13:55.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.375+0000 7ff845d16700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 0x7ff840161690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.375+0000 7ff845d16700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff840158a50 0x7ff84014a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840161200 con 0x7ff840162a30 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff840161bd0 con 0x7ff840158a50 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8401605f0 con 0x7ff840158670 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58418/0 (socket says 172.21.15.106:58418) 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 -- 172.21.15.106:0/2267120715 learned_addr learned my addr 172.21.15.106:0/2267120715 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83f7fe700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 0x7ff840161690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83effd700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff840158a50 0x7ff84014a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 -- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 msgr2=0x7ff840161690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 0x7ff840161690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 -- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff840158a50 msgr2=0x7ff84014a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff840158a50 0x7ff84014a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 -- 172.21.15.106:0/2267120715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff838009b30 con 0x7ff840162a30 2023-11-24T06:13:55.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83f7fe700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 0x7ff840161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff83ffff700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff838015040 tx=0x7ff838004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838004240 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8380043c0 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8401608d0 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff838004770 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.376+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff840160e90 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.377+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8400b2e00 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.378+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff838019070 con 0x7ff840162a30 2023-11-24T06:13:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.378+0000 7ff827fff700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 0x7ff82c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.378+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff83808a570 con 0x7ff840162a30 2023-11-24T06:13:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.378+0000 7ff83f7fe700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 0x7ff82c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.378+0000 7ff83f7fe700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 0x7ff82c06d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff8340099b0 tx=0x7ff834008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.382+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8380556b0 con 0x7ff840162a30 2023-11-24T06:13:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.618+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff840067f60 con 0x7ff840162a30 2023-11-24T06:13:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.619+0000 7ff827fff700 1 -- 172.21.15.106:0/2267120715 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7ff838058cd0 con 0x7ff840162a30 2023-11-24T06:13:55.622 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:13:55.623 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 msgr2=0x7ff82c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 0x7ff82c06d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff8340099b0 tx=0x7ff834008040 comp rx=0 tx=0).stop 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 msgr2=0x7ff84015f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff838015040 tx=0x7ff838004ad0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 shutdown_connections 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff82c06aed0 0x7ff82c06d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff840162a30 0x7ff84015f950 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff840158670 0x7ff840161690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 --2- 172.21.15.106:0/2267120715 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff840158a50 0x7ff84014a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 >> 172.21.15.106:0/2267120715 conn(0x7ff8400b57b0 msgr2=0x7ff84006e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 shutdown_connections 2023-11-24T06:13:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:55.621+0000 7ff845d16700 1 -- 172.21.15.106:0/2267120715 wait complete. 2023-11-24T06:13:55.628 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:13:56.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:13:41.314153+0000', 'modified': '2023-11-24T06:13:44.337653+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4282}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.176:6835/4280937312', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6833', 'nonce': 4280937312}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 4280937312}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:13:56.038 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:13:56.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-11-24T06:13:56.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.158+0000 7fd52431f700 1 Processor -- start 2023-11-24T06:13:56.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.158+0000 7fd52431f700 1 -- start start 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd52431f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd51c15e1b0 0x7fd51c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd52431f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0b1d40 con 0x7fd51c15ddd0 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd52431f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0b28c0 con 0x7fd51c0d2240 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd52431f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1f90 con 0x7fd51c15e1b0 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd5220bb700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd51c15ddd0 0x7fd51c0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38684/0 (socket says 172.21.15.106:38684) 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.159+0000 7fd5220bb700 1 -- 172.21.15.106:0/3941224303 learned_addr learned my addr 172.21.15.106:0/3941224303 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796812539 0 0) 0x7fd51c0b1d40 con 0x7fd51c15ddd0 2023-11-24T06:13:56.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5080035b0 con 0x7fd51c15ddd0 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> v2:172.21.15.176:3300/0 conn(0x7fd51c15e1b0 0x7fd51c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283293544 0 0) 0x7fd5080035b0 con 0x7fd51c15ddd0 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 >> v2:172.21.15.176:3300/0 conn(0x7fd51c15e1b0 msgr2=0x7fd51c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 --2- 172.21.15.106:0/3941224303 >> v2:172.21.15.176:3300/0 conn(0x7fd51c15e1b0 0x7fd51c0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 >> v1:172.21.15.176:6789/0 conn(0x7fd51c0d2240 legacy=0x7fd51c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0b2270 con 0x7fd51c15ddd0 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fd50c001670 con 0x7fd51c15ddd0 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> v2:172.21.15.176:3300/0 conn(0x7fd51c15e1b0 0x7fd51c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 >> v1:172.21.15.106:6789/0 conn(0x7fd51c15ddd0 legacy=0x7fd51c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd508003a00 0x7fd508003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd508004850 0x7fd508004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd50800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0b1f90 con 0x7fd508005410 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800c2a0 con 0x7fd508004850 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800c460 con 0x7fd508003a00 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd50800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5220bb700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd508003a00 0x7fd508003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 -- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd508003a00 msgr2=0x7fd508003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd508003a00 0x7fd508003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5218ba700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd508004850 0x7fd508004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 -- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd508004850 msgr2=0x7fd508004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd508004850 0x7fd508004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 -- 172.21.15.106:0/3941224303 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5080035b0 con 0x7fd508005410 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5218ba700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd508004850 0x7fd508004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 -- 172.21.15.106:0/3941224303 reap_dead start 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.160+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd50800ba10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5140073e0 tx=0x7fd508005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8165b71477d0a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514009490 con 0x7fd508005410 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514014400 con 0x7fd508005410 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd5210b9700 1 -- 172.21.15.106:0/3941224303 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514014790 con 0x7fd508005410 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 -- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 msgr2=0x7fd50800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd50800ba10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5140073e0 tx=0x7fd508005880 comp rx=0 tx=0).stop 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 -- 172.21.15.106:0/3941224303 shutdown_connections 2023-11-24T06:13:56.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 --2- 172.21.15.106:0/3941224303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd50800ba10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 -- 172.21.15.106:0/3941224303 >> 172.21.15.106:0/3941224303 conn(0x7fd51c0731a0 msgr2=0x7fd51c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 -- 172.21.15.106:0/3941224303 shutdown_connections 2023-11-24T06:13:56.169 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.161+0000 7fd52431f700 1 -- 172.21.15.106:0/3941224303 wait complete. 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.163+0000 7fd52431f700 1 Processor -- start 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.163+0000 7fd52431f700 1 -- start start 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd51c1f46b0 0x7fd51c09f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd51c09def0 0x7fd51c09e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c1f4b30 con 0x7fd508005410 2023-11-24T06:13:56.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c09fb00 con 0x7fd51c09def0 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c09d2b0 con 0x7fd51c1f46b0 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58434/0 (socket says 172.21.15.106:58434) 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 -- 172.21.15.106:0/620169598 learned_addr learned my addr 172.21.15.106:0/620169598 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5228bc700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd51c09def0 0x7fd51c09e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5218ba700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd51c1f46b0 0x7fd51c09f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 -- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd51c1f46b0 msgr2=0x7fd51c09f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd51c1f46b0 0x7fd51c09f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 -- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd51c09def0 msgr2=0x7fd51c09e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd51c09def0 0x7fd51c09e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 -- 172.21.15.106:0/620169598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c0b2ed0 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd5220bb700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0072c0 tx=0x7fd50c0075d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd512ffd700 1 -- 172.21.15.106:0/620169598 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0077b0 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd512ffd700 1 -- 172.21.15.106:0/620169598 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00f870 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c09ccf0 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd512ffd700 1 -- 172.21.15.106:0/620169598 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00fc20 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.164+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c09d6f0 con 0x7fd508005410 2023-11-24T06:13:56.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.166+0000 7fd512ffd700 1 -- 172.21.15.106:0/620169598 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd50c00fd80 con 0x7fd508005410 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.166+0000 7fd512ffd700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 0x7fd50006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.167+0000 7fd512ffd700 1 -- 172.21.15.106:0/620169598 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c0894a0 con 0x7fd508005410 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.167+0000 7fd5218ba700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 0x7fd50006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.167+0000 7fd5218ba700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 0x7fd50006d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd518007fd0 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.168+0000 7fd530518b80 1 Processor -- start 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.168+0000 7fd530518b80 1 -- start start 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c172d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c129490 0x556a2c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c09f770 con 0x556a2c12c080 2023-11-24T06:13:56.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c086750 con 0x556a2c129490 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2c084070 con 0x556a2c141ed0 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58442/0 (socket says 172.21.15.106:58442) 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5220bb700 1 -- 172.21.15.106:0/3508832752 learned_addr learned my addr 172.21.15.106:0/3508832752 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5218ba700 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c172d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5220bb700 1 -- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 msgr2=0x556a2c172d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.169+0000 7fd5228bc700 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c129490 0x556a2c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd5220bb700 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c172d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd5220bb700 1 -- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c129490 msgr2=0x556a2c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd5220bb700 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c129490 0x556a2c155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd5220bb700 1 -- 172.21.15.106:0/3508832752 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2befc5e0 con 0x556a2c12c080 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd5220bb700 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd50c060070 tx=0x7fd50c057cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1af282f3e6f8a0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd4fffff700 1 -- 172.21.15.106:0/3508832752 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c05e070 con 0x556a2c12c080 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd4fffff700 1 -- 172.21.15.106:0/3508832752 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0605a0 con 0x556a2c12c080 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd4fffff700 1 -- 172.21.15.106:0/3508832752 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0563e0 con 0x556a2c12c080 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 -- 172.21.15.106:0/3508832752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 msgr2=0x556a2c172840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd50c060070 tx=0x7fd50c057cd0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 -- 172.21.15.106:0/3508832752 shutdown_connections 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c129490 0x556a2c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c12c080 0x556a2c172840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 --2- 172.21.15.106:0/3508832752 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c172d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.170+0000 7fd530518b80 1 -- 172.21.15.106:0/3508832752 >> 172.21.15.106:0/3508832752 conn(0x556a2c05a310 msgr2=0x556a2c170e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.171+0000 7fd530518b80 1 -- 172.21.15.106:0/3508832752 shutdown_connections 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.171+0000 7fd530518b80 1 -- 172.21.15.106:0/3508832752 wait complete. 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.171+0000 7fd530518b80 1 -- start start 2023-11-24T06:13:56.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.171+0000 7fd530518b80 1 Processor -- start 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c158060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c180300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c07f960 con 0x556a2c129490 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c039510 con 0x556a2c12c080 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2c0391b0 con 0x556a2c141ed0 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd530518b80 10 client.0 _ll_register_callbacks cb 0x556a2bf64a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:13:56.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58448/0 (socket says 172.21.15.106:58448) 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 -- 172.21.15.106:0/77698663 learned_addr learned my addr 172.21.15.106:0/77698663 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5218ba700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5228bc700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c180300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 -- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 msgr2=0x556a2c180300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c180300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 -- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 msgr2=0x556a2c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5220bb700 1 -- 172.21.15.106:0/77698663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c09d6f0 con 0x556a2c129490 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.172+0000 7fd5218ba700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:13:56.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd5220bb700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd50c054750 tx=0x7fd50c089050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4342a92e8dd8bcf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0564a0 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c058500 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a2c11ea40 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50c0586c0 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 10 client.4653 fetch_fsmap learned FSMap version 8 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556a2bea8d90 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556a2c11ea40 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd50c057790 con 0x556a2c129490 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 10 client.4653 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:13:56.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 10 client.4653 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 20 client.4653 populate_metadata read hostname 'smithi106' 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c1683c0 0x556a2c1687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 4 client.4653 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 --> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a2c0fa840 con 0x556a2c1683c0 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.173+0000 7fd5218ba700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c1683c0 0x556a2c1687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd4fd7fa700 10 client.4653 ms_handle_connect on v2:172.21.15.176:6833/4280937312 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd5218ba700 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c1683c0 0x556a2c1687a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bde78097dbbbc3ec server_cookie=18b4472e6489b9ef in_seq=0 out_seq=0 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/77698663 <== mds.0 v2:172.21.15.176:6833/4280937312 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x556a2c0fa840 con 0x556a2c1683c0 2023-11-24T06:13:56.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd4fd7fa700 10 client.4653 handle_command_reply: tid=0 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd530518b80 1 client.4653 shutdown 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 msgr2=0x556a2c1560d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.174+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd50c054750 tx=0x7fd50c089050 comp rx=0 tx=0).stop 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 shutdown_connections 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c1683c0 0x556a2c1687a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c180300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd4fd7fa700 0 client.4653 ms_handle_reset on v2:172.21.15.176:6833/4280937312 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1560d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 --2- 172.21.15.106:0/77698663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 >> 172.21.15.106:0/77698663 conn(0x556a2c05a310 msgr2=0x556a2c174c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 shutdown_connections 2023-11-24T06:13:56.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 1 -- 172.21.15.106:0/77698663 wait complete. 2023-11-24T06:13:56.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.175+0000 7fd530518b80 20 client.4653 trim_cache size 0 max 16384 2023-11-24T06:13:56.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 Processor -- start 2023-11-24T06:13:56.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 -- start start 2023-11-24T06:13:56.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 0x556a2c16e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 0x556a2c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c128330 con 0x556a2c129490 2023-11-24T06:13:56.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2befe8d0 con 0x556a2c141ed0 2023-11-24T06:13:56.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2c126d70 con 0x556a2c12c080 2023-11-24T06:13:56.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58456/0 (socket says 172.21.15.106:58456) 2023-11-24T06:13:56.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.193+0000 7fd5220bb700 1 -- 172.21.15.106:0/1528501123 learned_addr learned my addr 172.21.15.106:0/1528501123 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5228bc700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 0x556a2c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 -- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 msgr2=0x556a2c16e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5218ba700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 0x556a2c16e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 0x556a2c16e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 -- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 msgr2=0x556a2c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 0x556a2c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 -- 172.21.15.106:0/1528501123 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a2be91c10 con 0x556a2c129490 2023-11-24T06:13:56.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5228bc700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 0x556a2c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:56.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5218ba700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 0x556a2c16e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:13:56.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd5220bb700 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd50c087cc0 tx=0x7fd50c054660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896013c4dfe5de67 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd510d82700 1 -- 172.21.15.106:0/1528501123 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0564a0 con 0x556a2c129490 2023-11-24T06:13:56.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd510d82700 1 -- 172.21.15.106:0/1528501123 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c057790 con 0x556a2c129490 2023-11-24T06:13:56.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd510d82700 1 -- 172.21.15.106:0/1528501123 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c060350 con 0x556a2c129490 2023-11-24T06:13:56.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 -- 172.21.15.106:0/1528501123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 msgr2=0x556a2c125f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd50c087cc0 tx=0x7fd50c054660 comp rx=0 tx=0).stop 2023-11-24T06:13:56.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 -- 172.21.15.106:0/1528501123 shutdown_connections 2023-11-24T06:13:56.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c141ed0 0x556a2c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c125f20 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 --2- 172.21.15.106:0/1528501123 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c12c080 0x556a2c16e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 -- 172.21.15.106:0/1528501123 >> 172.21.15.106:0/1528501123 conn(0x556a2c05a310 msgr2=0x556a2c172d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.194+0000 7fd530518b80 1 -- 172.21.15.106:0/1528501123 shutdown_connections 2023-11-24T06:13:56.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.195+0000 7fd530518b80 1 -- 172.21.15.106:0/1528501123 wait complete. 2023-11-24T06:13:56.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.195+0000 7fd530518b80 1 -- start start 2023-11-24T06:13:56.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.195+0000 7fd530518b80 1 Processor -- start 2023-11-24T06:13:56.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c16d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c17f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c1282d0 con 0x556a2c129490 2023-11-24T06:13:56.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a2c17ff70 con 0x556a2c12c080 2023-11-24T06:13:56.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x556a2c166800 con 0x556a2c141ed0 2023-11-24T06:13:56.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd530518b80 10 client.0 _ll_register_callbacks cb 0x556a2bf64a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:13:56.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58462/0 (socket says 172.21.15.106:58462) 2023-11-24T06:13:56.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 -- 172.21.15.106:0/4217296875 learned_addr learned my addr 172.21.15.106:0/4217296875 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5218ba700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c16d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5228bc700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c17f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 -- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 msgr2=0x556a2c17f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c17f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 -- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 msgr2=0x556a2c16d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c16d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 -- 172.21.15.106:0/4217296875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556a2bea8d90 con 0x556a2c129490 2023-11-24T06:13:56.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd4fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-24T06:13:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.196+0000 7fd5220bb700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd50c007290 tx=0x7fd50c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728e6f67802fe82b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c057900 con 0x556a2c129490 2023-11-24T06:13:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c054090 con 0x556a2c129490 2023-11-24T06:13:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd50c0605a0 con 0x556a2c129490 2023-11-24T06:13:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50c0564a0 con 0x556a2c129490 2023-11-24T06:13:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 10 client.4659 fetch_fsmap learned FSMap version 8 2023-11-24T06:13:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x556a2becf200 con 0x556a2c129490 2023-11-24T06:13:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c0605a0 con 0x556a2c129490 2023-11-24T06:13:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fd50c054250 con 0x556a2c129490 2023-11-24T06:13:56.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 10 client.4659 fetch_fsmap finished waiting for FSMap version 8 2023-11-24T06:13:56.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 10 client.4659 resolve_mds: resolved name 'd' to daemon mds.d 2023-11-24T06:13:56.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 20 client.4659 populate_metadata read hostname 'smithi106' 2023-11-24T06:13:56.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c126d70 0x556a2c11fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 4 client.4659 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:13:56.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 --> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556a2c045f80 con 0x556a2c126d70 2023-11-24T06:13:56.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.197+0000 7fd5218ba700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c126d70 0x556a2c11fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd4fd7fa700 10 client.4659 ms_handle_connect on v2:172.21.15.176:6833/4280937312 2023-11-24T06:13:56.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd5218ba700 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c126d70 0x556a2c11fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd9e216dbad3c37d server_cookie=65e79350f554b930 in_seq=0 out_seq=0 2023-11-24T06:13:56.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd4fd7fa700 1 -- 172.21.15.106:0/4217296875 <== mds.0 v2:172.21.15.176:6833/4280937312 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x556a2c045f80 con 0x556a2c126d70 2023-11-24T06:13:56.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd4fd7fa700 10 client.4659 handle_command_reply: tid=0 2023-11-24T06:13:56.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 client.4659 shutdown 2023-11-24T06:13:56.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 msgr2=0x556a2c1d9200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd50c007290 tx=0x7fd50c001a00 comp rx=0 tx=0).stop 2023-11-24T06:13:56.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 shutdown_connections 2023-11-24T06:13:56.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:6833/4280937312,v1:172.21.15.176:6835/4280937312] conn(0x556a2c126d70 0x556a2c11fcb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x556a2c141ed0 0x556a2c17f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556a2c129490 0x556a2c1d9200 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd4fd7fa700 0 client.4659 ms_handle_reset on v2:172.21.15.176:6833/4280937312 2023-11-24T06:13:56.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 --2- 172.21.15.106:0/4217296875 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x556a2c12c080 0x556a2c16d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 >> 172.21.15.106:0/4217296875 conn(0x556a2c05a310 msgr2=0x556a2c127450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 shutdown_connections 2023-11-24T06:13:56.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 1 -- 172.21.15.106:0/4217296875 wait complete. 2023-11-24T06:13:56.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd530518b80 20 client.4659 trim_cache size 0 max 16384 2023-11-24T06:13:56.228 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:13:56.228 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "2a42eb6f-5aad-4f8e-8067-d72b439cd81f", 2023-11-24T06:13:56.228 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-11-24T06:13:56.228 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4282, 2023-11-24T06:13:56.229 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-11-24T06:13:56.229 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-11-24T06:13:56.229 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-11-24T06:13:56.229 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 14.267909637000001, 2023-11-24T06:13:56.230 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 8, 2023-11-24T06:13:56.230 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 20, 2023-11-24T06:13:56.230 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 20, 2023-11-24T06:13:56.230 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 21.910008533999999 2023-11-24T06:13:56.230 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:13:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.198+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 msgr2=0x7fd50006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 0x7fd50006d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd518007fd0 tx=0x7fd518009040 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 msgr2=0x7fd51c1f1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0072c0 tx=0x7fd50c0075d0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 shutdown_connections 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd50006aed0 0x7fd50006d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd51c09def0 0x7fd51c09e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd508005410 0x7fd51c1f1150 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 --2- 172.21.15.106:0/620169598 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd51c1f46b0 0x7fd51c09f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 >> 172.21.15.106:0/620169598 conn(0x7fd51c0731a0 msgr2=0x7fd51c0aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 shutdown_connections 2023-11-24T06:13:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.199+0000 7fd52431f700 1 -- 172.21.15.106:0/620169598 wait complete. 2023-11-24T06:13:56.233 INFO:teuthology.run_tasks:Running task kclient... 2023-11-24T06:13:56.255 INFO:tasks.kclient:Mounting kernel clients... 2023-11-24T06:13:56.255 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-11-24T06:13:56.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.256 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:13:56.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:13:56.340 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2023-11-24T06:13:56.341 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.342 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:13:56.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.400 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:13:56.466 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2023-11-24T06:13:56.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.467 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:13:56.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.488 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:13:56.563 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-24T06:13:56.565 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.565 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:13:56.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:56.626 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:13:56.697 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-24T06:13:56.698 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:13:56.698 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-11-24T06:13:56.699 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:13:56.699 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:56.699 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:13:56.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.819+0000 7fa496b15700 1 Processor -- start 2023-11-24T06:13:56.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.819+0000 7fa496b15700 1 -- start start 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa496b15700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa49015a3b0 0x7fa4900b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa496b15700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4900cf360 0x7fa4900b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa496b15700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa49015a790 con 0x7fa4900b3da0 2023-11-24T06:13:56.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa496b15700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49015eec0 con 0x7fa49015a3b0 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa496b15700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900cf8b0 con 0x7fa4900cf360 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa49015a3b0 0x7fa4900b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa49015a3b0 0x7fa4900b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58470/0 (socket says 172.21.15.106:58470) 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 -- 172.21.15.106:0/3055887253 learned_addr learned my addr 172.21.15.106:0/3055887253 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 -- 172.21.15.106:0/3055887253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4900cf360 msgr2=0x7fa4900b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 --2- 172.21.15.106:0/3055887253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4900cf360 0x7fa4900b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 -- 172.21.15.106:0/3055887253 >> v1:172.21.15.176:6789/0 conn(0x7fa4900b3da0 legacy=0x7fa49006dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 -- 172.21.15.106:0/3055887253 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900b4c40 con 0x7fa49015a3b0 2023-11-24T06:13:56.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa4948b1700 1 --2- 172.21.15.106:0/3055887253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa49015a3b0 0x7fa4900b3320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa484009920 tx=0x7fa484009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c955e64827aec7d2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa48f7fe700 1 -- 172.21.15.106:0/3055887253 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484004230 con 0x7fa49015a3b0 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa48f7fe700 1 -- 172.21.15.106:0/3055887253 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa484004390 con 0x7fa49015a3b0 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.820+0000 7fa48f7fe700 1 -- 172.21.15.106:0/3055887253 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484009e70 con 0x7fa49015a3b0 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 -- 172.21.15.106:0/3055887253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa49015a3b0 msgr2=0x7fa4900b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 --2- 172.21.15.106:0/3055887253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa49015a3b0 0x7fa4900b3320 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa484009920 tx=0x7fa484009c30 comp rx=0 tx=0).stop 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 -- 172.21.15.106:0/3055887253 shutdown_connections 2023-11-24T06:13:56.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 --2- 172.21.15.106:0/3055887253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa49015a3b0 0x7fa4900b3320 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 --2- 172.21.15.106:0/3055887253 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa4900cf360 0x7fa4900b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 -- 172.21.15.106:0/3055887253 >> 172.21.15.106:0/3055887253 conn(0x7fa4900b1740 msgr2=0x7fa4900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:56.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 -- 172.21.15.106:0/3055887253 shutdown_connections 2023-11-24T06:13:56.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.821+0000 7fa496b15700 1 -- 172.21.15.106:0/3055887253 wait complete. 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.822+0000 7fa496b15700 1 Processor -- start 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.822+0000 7fa496b15700 1 -- start start 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4900cf360 0x7fa4900c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa49015a3b0 0x7fa4900c4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c6500 con 0x7fa4900b3da0 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c5500 con 0x7fa4900cf360 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa496b15700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4900c57e0 con 0x7fa49015a3b0 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58476/0 (socket says 172.21.15.106:58476) 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 -- 172.21.15.106:0/4044891487 learned_addr learned my addr 172.21.15.106:0/4044891487 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4950b2700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa49015a3b0 0x7fa4900c4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa48ffff700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4900cf360 0x7fa4900c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 -- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa49015a3b0 msgr2=0x7fa4900c4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa49015a3b0 0x7fa4900c4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 -- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4900cf360 msgr2=0x7fa4900c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4900cf360 0x7fa4900c49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 -- 172.21.15.106:0/4044891487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa484009550 con 0x7fa4900b3da0 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.823+0000 7fa4948b1700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa484004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.824+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa48401e070 con 0x7fa4900b3da0 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.824+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4840036a0 con 0x7fa4900b3da0 2023-11-24T06:13:56.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.824+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa484003a30 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.824+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4900c6750 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.824+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4900cb2a0 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.825+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4900751e0 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.825+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa484003b90 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.825+0000 7fa48d7fa700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 0x7fa47406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.825+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa48408b5d0 con 0x7fa4900b3da0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.825+0000 7fa48ffff700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 0x7fa47406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:56.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.826+0000 7fa48ffff700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 0x7fa47406d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4900cdad0 tx=0x7fa47c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:56.830+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa484056830 con 0x7fa4900b3da0 2023-11-24T06:13:57.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.064+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4900cfc00 con 0x7fa4900b3da0 2023-11-24T06:13:57.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.065+0000 7fa48d7fa700 1 -- 172.21.15.106:0/4044891487 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa484059e50 con 0x7fa4900b3da0 2023-11-24T06:13:57.068 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 msgr2=0x7fa47406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 0x7fa47406d390 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa4900cdad0 tx=0x7fa47c009190 comp rx=0 tx=0).stop 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 msgr2=0x7fa4900c94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa484009870 tx=0x7fa484004750 comp rx=0 tx=0).stop 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 shutdown_connections 2023-11-24T06:13:57.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa47406aed0 0x7fa47406d390 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa49015a3b0 0x7fa4900c4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4900b3da0 0x7fa4900c94c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 --2- 172.21.15.106:0/4044891487 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa4900cf360 0x7fa4900c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 >> 172.21.15.106:0/4044891487 conn(0x7fa4900b1740 msgr2=0x7fa49014e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 shutdown_connections 2023-11-24T06:13:57.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:57.067+0000 7fa496b15700 1 -- 172.21.15.106:0/4044891487 wait complete. 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:13:57.082 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:13:57.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:13:57.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.083 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-11-24T06:13:57.099 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:57.100 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::151c:cf3b:24ac:89aa/64 scope link noprefixroute 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:57.101 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:13:57.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:13:57.102 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:57.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.272 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:13:57.299 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-11-24T06:13:57.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.301 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-11-24T06:13:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-11-24T06:13:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:13:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:13:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:13:57.375 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:13:57.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:13:57.376 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:57.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.648 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:13:57.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.664 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2023-11-24T06:13:57.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.721 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:57.722 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:57.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:57.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-24T06:13:57.722 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:57.816 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-24T06:13:57.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:57.816 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:57.816 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:57.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-24T06:13:57.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:13:57.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-24T06:13:57.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-24T06:13:57.817 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-24T06:13:57.817 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:58.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.017 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:58.017 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:58.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-11-24T06:13:58.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:13:58.018 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:58.122 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:58.122 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:58.141 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:13:58.141 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:13:58.141 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:58.198 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:13:58.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:13:58.319 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:13:58.319 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:13:58.320 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:13:58.417 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:13:58.418 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:13:58.418 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:13:58.418 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:13:58.418 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:13:58.454 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:13:58.455 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:13:58.465 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:13:58.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.465 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:13:58.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.496 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:13:58.591 INFO:teuthology.orchestra.run.smithi106.stdout:client4543 2023-11-24T06:13:58.591 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:13:58.591 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:13:58.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.608 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:13:58.700 INFO:teuthology.orchestra.run.smithi106.stdout:client4543 2023-11-24T06:13:58.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.700 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:13:58.747 INFO:teuthology.orchestra.run.smithi106.stdout:client4543 2023-11-24T06:13:58.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:58.747 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a42eb6f-5aad-4f8e-8067-d72b439cd81f.client4543/status') 2023-11-24T06:13:58.803 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.4543 (3)172.21.15.106:0/3643789641 2023-11-24T06:13:58.803 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2023-11-24T06:13:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2023-11-24T06:13:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2023-11-24T06:13:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:71 bytes copied, 2.4056e-05 s, 3.0 MB/s 2023-11-24T06:13:58.804 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-11-24T06:13:58.805 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:13:58.805 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:13:58.805 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:13:58.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.923+0000 7fa866510700 1 Processor -- start 2023-11-24T06:13:58.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.923+0000 7fa866510700 1 -- start start 2023-11-24T06:13:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa866510700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa86015e080 0x7fa8600b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa866510700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa8600af4d0 0x7fa8600afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa866510700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600ae430 con 0x7fa86006c000 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa866510700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600af0b0 con 0x7fa86015e080 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa866510700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600b05a0 con 0x7fa8600af4d0 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa86015e080 0x7fa8600b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa86015e080 0x7fa8600b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58500/0 (socket says 172.21.15.106:58500) 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 -- 172.21.15.106:0/3842600641 learned_addr learned my addr 172.21.15.106:0/3842600641 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 -- 172.21.15.106:0/3842600641 >> v2:172.21.15.176:3300/0 conn(0x7fa8600af4d0 msgr2=0x7fa8600afb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 --2- 172.21.15.106:0/3842600641 >> v2:172.21.15.176:3300/0 conn(0x7fa8600af4d0 0x7fa8600afb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 -- 172.21.15.106:0/3842600641 >> v1:172.21.15.176:6789/0 conn(0x7fa86006c000 legacy=0x7fa860073f90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.924+0000 7fa85ffff700 1 -- 172.21.15.106:0/3842600641 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600ae710 con 0x7fa86015e080 2023-11-24T06:13:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa85ffff700 1 --2- 172.21.15.106:0/3842600641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86015e080 0x7fa8600b5050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa86006e4e0 tx=0x7fa854009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9582495d6336726e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa85effd700 1 -- 172.21.15.106:0/3842600641 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854004230 con 0x7fa86015e080 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa85effd700 1 -- 172.21.15.106:0/3842600641 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa854004390 con 0x7fa86015e080 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa85effd700 1 -- 172.21.15.106:0/3842600641 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540036a0 con 0x7fa86015e080 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 -- 172.21.15.106:0/3842600641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86015e080 msgr2=0x7fa8600b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 --2- 172.21.15.106:0/3842600641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86015e080 0x7fa8600b5050 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa86006e4e0 tx=0x7fa854009c00 comp rx=0 tx=0).stop 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 -- 172.21.15.106:0/3842600641 shutdown_connections 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 --2- 172.21.15.106:0/3842600641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86015e080 0x7fa8600b5050 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 --2- 172.21.15.106:0/3842600641 >> v2:172.21.15.176:3300/0 conn(0x7fa8600af4d0 0x7fa8600afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 -- 172.21.15.106:0/3842600641 >> 172.21.15.106:0/3842600641 conn(0x7fa860071b90 msgr2=0x7fa860071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 -- 172.21.15.106:0/3842600641 shutdown_connections 2023-11-24T06:13:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.925+0000 7fa866510700 1 -- 172.21.15.106:0/3842600641 wait complete. 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.927+0000 7fa866510700 1 Processor -- start 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.927+0000 7fa866510700 1 -- start start 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.927+0000 7fa866510700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa86006c000 0x7fa86015f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa86015e080 0x7fa8601493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c6110 con 0x7fa8600af4d0 2023-11-24T06:13:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015f9e0 con 0x7fa86006c000 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015fcc0 con 0x7fa86015e080 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58508/0 (socket says 172.21.15.106:58508) 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1881226332 learned_addr learned my addr 172.21.15.106:0/1881226332 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa86015e080 msgr2=0x7fa8601493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa86015e080 0x7fa8601493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa86006c000 msgr2=0x7fa86015f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa86006c000 0x7fa86015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 -- 172.21.15.106:0/1881226332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa854009550 con 0x7fa8600af4d0 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85f7fe700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa85000b550 tx=0x7fa85000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011830 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850011990 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa86015ffa0 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011d20 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.928+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa860160560 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.929+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa860160720 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.930+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa85001a400 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.930+0000 7fa85cff9700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 0x7fa84c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.930+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa850089590 con 0x7fa8600af4d0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.930+0000 7fa85ffff700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 0x7fa84c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:13:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.930+0000 7fa85ffff700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 0x7fa84c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa86006e760 tx=0x7fa854010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:13:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:58.934+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8500546d0 con 0x7fa8600af4d0 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.168+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa8600753f0 con 0x7fa8600af4d0 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.169+0000 7fa85cff9700 1 -- 172.21.15.106:0/1881226332 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa850057cf0 con 0x7fa8600af4d0 2023-11-24T06:13:59.171 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:13:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 msgr2=0x7fa84c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 0x7fa84c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa86006e760 tx=0x7fa854010000 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 msgr2=0x7fa8600c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa85000b550 tx=0x7fa85000b910 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 shutdown_connections 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa84c06aed0 0x7fa84c06d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa86015e080 0x7fa8601493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa86006c000 0x7fa86015f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 --2- 172.21.15.106:0/1881226332 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8600af4d0 0x7fa8600c5bd0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 >> 172.21.15.106:0/1881226332 conn(0x7fa860071b90 msgr2=0x7fa8600b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 shutdown_connections 2023-11-24T06:13:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:13:59.171+0000 7fa866510700 1 -- 172.21.15.106:0/1881226332 wait complete. 2023-11-24T06:13:59.185 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:13:59.185 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:13:59.185 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:13:59.186 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:13:59.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.186 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42404sec preferred_lft 42404sec 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::151c:cf3b:24ac:89aa/64 scope link noprefixroute 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:59:cb:85:54:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:13:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::80d2:3cff:fe26:794c/64 scope link 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:59:cb:85:54:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c459:cbff:fe85:5439/64 scope link tentative 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.206 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:13:59.269 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-11-24T06:13:59.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.271 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:13:59.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:13:59.331 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:59.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.436 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:13:59.452 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:13:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.453 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2023-11-24T06:13:59.509 INFO:teuthology.orchestra.run.smithi106.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-11-24T06:13:59.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.510 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:59.510 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:59.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:13:59.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-11-24T06:13:59.510 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:59.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.602 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:13:59.639 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:d2:9c:6e:cd:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c4d2:9cff:fe6e:cdd3/64 scope link 2023-11-24T06:13:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.654 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-11-24T06:13:59.729 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:d2:9c:6e:cd:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c4d2:9cff:fe6e:cdd3/64 scope link 2023-11-24T06:13:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:13:59.742 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-11-24T06:13:59.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-11-24T06:13:59.742 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:13:59.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:13:59.993 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:13:59.993 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:13:59.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.1 up 2023-11-24T06:13:59.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:13:59.993 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:14:00.101 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:00.101 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-11-24T06:14:00.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:00.126 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:14:00.182 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:14:00.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.182 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T06:14:00.267 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T06:14:00.268 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T06:14:00.268 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:00.276 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T06:14:00.276 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T06:14:00.276 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:00.276 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:00.276 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:00.313 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:14:00.450 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:14:00.453 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:14:00.454 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:14:00.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-11-24T06:14:00.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.481 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:00.553 INFO:teuthology.orchestra.run.smithi106.stdout:client4674 2023-11-24T06:14:00.554 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:00.554 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:00.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.611 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:00.683 INFO:teuthology.orchestra.run.smithi106.stdout:client4674 2023-11-24T06:14:00.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.684 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:00.756 INFO:teuthology.orchestra.run.smithi106.stdout:client4674 2023-11-24T06:14:00.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:00.757 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a42eb6f-5aad-4f8e-8067-d72b439cd81f.client4674/status') 2023-11-24T06:14:00.836 INFO:teuthology.orchestra.run.smithi106.stdout:instance: client.4674 (3)192.168.0.2:0/564996780 2023-11-24T06:14:00.836 INFO:teuthology.orchestra.run.smithi106.stdout:blocklisted: false 2023-11-24T06:14:00.836 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records in 2023-11-24T06:14:00.837 INFO:teuthology.orchestra.run.smithi106.stderr:0+1 records out 2023-11-24T06:14:00.837 INFO:teuthology.orchestra.run.smithi106.stderr:68 bytes copied, 2.1354e-05 s, 3.2 MB/s 2023-11-24T06:14:00.838 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-11-24T06:14:00.838 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:14:00.838 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:00.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.995+0000 7fd786aaa700 1 Processor -- start 2023-11-24T06:14:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.995+0000 7fd786aaa700 1 -- start start 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fd78015e080 0x7fd7800b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7800af4d0 0x7fd7800afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd78006c000 0x7fd78006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7800af0b0 con 0x7fd78006c000 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd78006c9f0 con 0x7fd78015e080 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd786aaa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800b05a0 con 0x7fd7800af4d0 2023-11-24T06:14:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd78006c000 0x7fd78006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd78006c000 0x7fd78006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58522/0 (socket says 172.21.15.106:58522) 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 -- 172.21.15.106:0/2198041690 learned_addr learned my addr 172.21.15.106:0/2198041690 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd784846700 1 --2- 172.21.15.106:0/2198041690 >> v2:172.21.15.176:3300/0 conn(0x7fd78015e080 0x7fd7800b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 -- 172.21.15.106:0/2198041690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7800af4d0 msgr2=0x7fd7800afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 --2- 172.21.15.106:0/2198041690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7800af4d0 0x7fd7800afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 -- 172.21.15.106:0/2198041690 >> v2:172.21.15.176:3300/0 conn(0x7fd78015e080 msgr2=0x7fd7800b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 --2- 172.21.15.106:0/2198041690 >> v2:172.21.15.176:3300/0 conn(0x7fd78015e080 0x7fd7800b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 -- 172.21.15.106:0/2198041690 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800ae430 con 0x7fd78006c000 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd785047700 1 --2- 172.21.15.106:0/2198041690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd78006c4b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd780072a90 tx=0x7fd77800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46046b82804c29a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd77f7fe700 1 -- 172.21.15.106:0/2198041690 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800e070 con 0x7fd78006c000 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd77f7fe700 1 -- 172.21.15.106:0/2198041690 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77800b980 con 0x7fd78006c000 2023-11-24T06:14:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.996+0000 7fd77f7fe700 1 -- 172.21.15.106:0/2198041690 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77800bd30 con 0x7fd78006c000 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 -- 172.21.15.106:0/2198041690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 msgr2=0x7fd78006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 --2- 172.21.15.106:0/2198041690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd78006c4b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd780072a90 tx=0x7fd77800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 -- 172.21.15.106:0/2198041690 shutdown_connections 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 --2- 172.21.15.106:0/2198041690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd78006c4b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 --2- 172.21.15.106:0/2198041690 >> v2:172.21.15.176:3300/0 conn(0x7fd78015e080 0x7fd7800b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 --2- 172.21.15.106:0/2198041690 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd7800af4d0 0x7fd7800afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 -- 172.21.15.106:0/2198041690 >> 172.21.15.106:0/2198041690 conn(0x7fd780071b90 msgr2=0x7fd780071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 -- 172.21.15.106:0/2198041690 shutdown_connections 2023-11-24T06:14:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.997+0000 7fd786aaa700 1 -- 172.21.15.106:0/2198041690 wait complete. 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.999+0000 7fd786aaa700 1 Processor -- start 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:00.999+0000 7fd786aaa700 1 -- start start 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7800af4d0 0x7fd7800c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78015e080 0x7fd7800c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800cf400 con 0x7fd78006c000 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800cf6e0 con 0x7fd7800af4d0 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800cf9c0 con 0x7fd78015e080 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.005 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58524/0 (socket says 172.21.15.106:58524) 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 -- 172.21.15.106:0/3896635113 learned_addr learned my addr 172.21.15.106:0/3896635113 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd785047700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78015e080 0x7fd7800c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 -- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78015e080 msgr2=0x7fd7800c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78015e080 0x7fd7800c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 -- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7800af4d0 msgr2=0x7fd7800c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7800af4d0 0x7fd7800c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 -- 172.21.15.106:0/3896635113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778009b30 con 0x7fd78006c000 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd784846700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd77400d800 tx=0x7fd77400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7740125f0 con 0x7fd78006c000 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd774012750 con 0x7fd78006c000 2023-11-24T06:14:01.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7800cfca0 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd774012b00 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.000+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800cc9e0 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.001+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7800753f0 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.002+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd774012c60 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.002+0000 7fd77d7fa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 0x7fd76406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.002+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd774089810 con 0x7fd78006c000 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.002+0000 7fd77ffff700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 0x7fd76406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:01.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.003+0000 7fd77ffff700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 0x7fd76406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7800b3b40 tx=0x7fd76c006d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:01.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.007+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd774054950 con 0x7fd78006c000 2023-11-24T06:14:01.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.239+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd780072cd0 con 0x7fd78006c000 2023-11-24T06:14:01.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.239+0000 7fd77d7fa700 1 -- 172.21.15.106:0/3896635113 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd774057f70 con 0x7fd78006c000 2023-11-24T06:14:01.242 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:01.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 msgr2=0x7fd76406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 0x7fd76406d390 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd7800b3b40 tx=0x7fd76c006d20 comp rx=0 tx=0).stop 2023-11-24T06:14:01.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 msgr2=0x7fd7800cc4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:01.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd77400d800 tx=0x7fd77400db10 comp rx=0 tx=0).stop 2023-11-24T06:14:01.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 shutdown_connections 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd76406aed0 0x7fd76406d390 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd78015e080 0x7fd7800c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd78006c000 0x7fd7800cc4a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 --2- 172.21.15.106:0/3896635113 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd7800af4d0 0x7fd7800c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 >> 172.21.15.106:0/3896635113 conn(0x7fd780071b90 msgr2=0x7fd78015d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 shutdown_connections 2023-11-24T06:14:01.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:01.241+0000 7fd786aaa700 1 -- 172.21.15.106:0/3896635113 wait complete. 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:01.257 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:01.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.258 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-24T06:14:01.278 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:01.279 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42407sec preferred_lft 42407sec 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3daf:528e:a8b9:4250/64 scope link noprefixroute 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:01.280 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-24T06:14:01.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add name ceph-brx type bridge 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr flush dev ceph-brx 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set ceph-brx up 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-24T06:14:01.281 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:01.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.455 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:01.485 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-24T06:14:01.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.487 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-24T06:14:01.558 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-24T06:14:01.559 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:01.559 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:14:01.559 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:14:01.559 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:01.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.559 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:01.559 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:01.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:14:01.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:14:01.560 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:14:01.560 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:01.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.805 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:14:01.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.822 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2023-11-24T06:14:01.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.878 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:01.878 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:01.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:01.878 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-11-24T06:14:01.879 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:01.971 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-11-24T06:14:01.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:01.971 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-11-24T06:14:01.972 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:02.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.192 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:02.192 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:02.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2023-11-24T06:14:02.192 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.0 master ceph-brx 2023-11-24T06:14:02.192 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:02.294 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:02.294 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:02.314 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:02.314 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:02.314 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:02.370 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:14:02.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.370 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:02.478 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:02.478 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:02.478 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:02.578 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:02.578 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:02.578 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:02.578 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:02.578 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:14:02.653 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:14:02.654 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:14:02.656 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:14:02.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.656 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:02.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.683 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:02.756 INFO:teuthology.orchestra.run.smithi176.stdout:client4683 2023-11-24T06:14:02.756 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:02.756 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:02.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.814 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:02.885 INFO:teuthology.orchestra.run.smithi176.stdout:client4683 2023-11-24T06:14:02.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.886 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:02.957 INFO:teuthology.orchestra.run.smithi176.stdout:client4683 2023-11-24T06:14:02.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:02.958 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a42eb6f-5aad-4f8e-8067-d72b439cd81f.client4683/status') 2023-11-24T06:14:03.038 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4683 (3)172.21.15.176:0/1138232640 2023-11-24T06:14:03.038 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2023-11-24T06:14:03.038 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2023-11-24T06:14:03.038 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2023-11-24T06:14:03.038 INFO:teuthology.orchestra.run.smithi176.stderr:71 bytes copied, 2.1593e-05 s, 3.3 MB/s 2023-11-24T06:14:03.039 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-11-24T06:14:03.039 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-24T06:14:03.039 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:14:03.040 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:03.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.179+0000 7f85c0787700 1 Processor -- start 2023-11-24T06:14:03.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.179+0000 7f85c0787700 1 -- start start 2023-11-24T06:14:03.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85c0787700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85b815e080 0x7f85b80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85c0787700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80ae430 con 0x7f85b806c710 2023-11-24T06:14:03.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85c0787700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80ae710 con 0x7f85b80af4d0 2023-11-24T06:14:03.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85c0787700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b80af0b0 con 0x7f85b815e080 2023-11-24T06:14:03.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85be523700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85b815e080 0x7f85b80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85bed24700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f85b806c710 0x7f85b806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38796/0 (socket says 172.21.15.106:38796) 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85bed24700 1 -- 172.21.15.106:0/2422988969 learned_addr learned my addr 172.21.15.106:0/2422988969 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85be523700 1 -- 172.21.15.106:0/2422988969 >> v1:172.21.15.176:6789/0 conn(0x7f85b80af4d0 legacy=0x7f85b806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85be523700 1 -- 172.21.15.106:0/2422988969 >> v1:172.21.15.106:6789/0 conn(0x7f85b806c710 legacy=0x7f85b806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85be523700 1 -- 172.21.15.106:0/2422988969 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80ae9f0 con 0x7f85b815e080 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85be523700 1 --2- 172.21.15.106:0/2422988969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b815e080 0x7f85b80b5050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4101e622c70502 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85bd521700 1 -- 172.21.15.106:0/2422988969 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4004230 con 0x7f85b815e080 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.180+0000 7f85bd521700 1 -- 172.21.15.106:0/2422988969 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4004390 con 0x7f85b815e080 2023-11-24T06:14:03.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85bd521700 1 -- 172.21.15.106:0/2422988969 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b40036a0 con 0x7f85b815e080 2023-11-24T06:14:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 -- 172.21.15.106:0/2422988969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b815e080 msgr2=0x7f85b80b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 --2- 172.21.15.106:0/2422988969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b815e080 0x7f85b80b5050 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f85b4009840 tx=0x7f85b4009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 -- 172.21.15.106:0/2422988969 shutdown_connections 2023-11-24T06:14:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 --2- 172.21.15.106:0/2422988969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b815e080 0x7f85b80b5050 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 -- 172.21.15.106:0/2422988969 >> 172.21.15.106:0/2422988969 conn(0x7f85b8071b90 msgr2=0x7f85b8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 -- 172.21.15.106:0/2422988969 shutdown_connections 2023-11-24T06:14:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.181+0000 7f85c0787700 1 -- 172.21.15.106:0/2422988969 wait complete. 2023-11-24T06:14:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.182+0000 7f85c0787700 1 Processor -- start 2023-11-24T06:14:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.182+0000 7f85c0787700 1 -- start start 2023-11-24T06:14:03.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85b80af4d0 0x7f85b8158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85b815e080 0x7f85b81594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8154ce0 con 0x7f85b806c710 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8154fc0 con 0x7f85b80af4d0 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85c0787700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b81552a0 con 0x7f85b815e080 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85be523700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85be523700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58536/0 (socket says 172.21.15.106:58536) 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.183+0000 7f85be523700 1 -- 172.21.15.106:0/2854951546 learned_addr learned my addr 172.21.15.106:0/2854951546 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 -- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85b815e080 msgr2=0x7f85b81594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85b815e080 0x7f85b81594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 -- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85b80af4d0 msgr2=0x7f85b8158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85bdd22700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85b80af4d0 0x7f85b8158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85b80af4d0 0x7f85b8158fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 -- 172.21.15.106:0/2854951546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40094a0 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85be523700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85b40090b0 tx=0x7f85b40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4011630 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b4011790 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4011b40 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b8155580 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.184+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b81f71d0 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.185+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b80753f0 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.185+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f85b4011ca0 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.186+0000 7f85aeffd700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 0x7f859c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.186+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85b408ae80 con 0x7f85b806c710 2023-11-24T06:14:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.186+0000 7f85bdd22700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 0x7f859c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:03.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.186+0000 7f85bdd22700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 0x7f859c06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b0540 tx=0x7f85a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:03.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.190+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f85b4055fc0 con 0x7f85b806c710 2023-11-24T06:14:03.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.424+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85b8067f60 con 0x7f85b806c710 2023-11-24T06:14:03.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.424+0000 7f85aeffd700 1 -- 172.21.15.106:0/2854951546 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f85b40595e0 con 0x7f85b806c710 2023-11-24T06:14:03.427 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 msgr2=0x7f859c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 0x7f859c06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b0540 tx=0x7f85a8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 msgr2=0x7f85b81f6c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f85b40090b0 tx=0x7f85b40047c0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 shutdown_connections 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f859c06aed0 0x7f859c06d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85b815e080 0x7f85b81594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85b806c710 0x7f85b81f6c90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 --2- 172.21.15.106:0/2854951546 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f85b80af4d0 0x7f85b8158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 >> 172.21.15.106:0/2854951546 conn(0x7f85b8071b90 msgr2=0x7f85b806f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 shutdown_connections 2023-11-24T06:14:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:03.427+0000 7f85c0787700 1 -- 172.21.15.106:0/2854951546 wait complete. 2023-11-24T06:14:03.441 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-24T06:14:03.441 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:03.442 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:14:03.442 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.442 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:03.461 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42405sec preferred_lft 42405sec 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3daf:528e:a8b9:4250/64 scope link noprefixroute 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether ca:fb:b9:5a:28:40 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.462 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec28:6ff:fe6c:dae6/64 scope link 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether ca:fb:b9:5a:28:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c8fb:b9ff:fe5a:2840/64 scope link tentative 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.463 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:03.527 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-24T06:14:03.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.529 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-24T06:14:03.587 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-24T06:14:03.587 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:03.587 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:14:03.587 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:14:03.588 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:03.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:14:03.588 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:03.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.692 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:14:03.708 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:14:03.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.709 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list-id 2023-11-24T06:14:03.765 INFO:teuthology.orchestra.run.smithi176.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-11-24T06:14:03.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.765 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:03.765 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:03.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:03.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-11-24T06:14:03.766 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:03.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.859 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether c6:8c:a1:10:0e:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:14:03.900 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.901 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c48c:a1ff:fe10:e6c/64 scope link 2023-11-24T06:14:03.901 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:03.912 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether c6:8c:a1:10:0e:6c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-11-24T06:14:03.997 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-11-24T06:14:03.998 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:03.998 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c48c:a1ff:fe10:e6c/64 scope link 2023-11-24T06:14:03.998 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:04.017 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-11-24T06:14:04.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-11-24T06:14:04.018 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-11-24T06:14:04.019 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:04.290 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.291 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:04.291 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:04.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.1 up 2023-11-24T06:14:04.291 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set dev brx.1 master ceph-brx 2023-11-24T06:14:04.291 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:04.412 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:04.412 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-11-24T06:14:04.429 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-11-24T06:14:04.429 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:04.429 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:14:04.485 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:14:04.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.486 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T06:14:04.570 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T06:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T06:14:04.571 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T06:14:04.579 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T06:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:04.580 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:04.616 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:14:04.617 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:14:04.629 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:14:04.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.629 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-11-24T06:14:04.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.657 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:04.729 INFO:teuthology.orchestra.run.smithi176.stdout:client4549 2023-11-24T06:14:04.729 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:04.729 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:04.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.786 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:04.857 INFO:teuthology.orchestra.run.smithi176.stdout:client4549 2023-11-24T06:14:04.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.858 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:04.929 INFO:teuthology.orchestra.run.smithi176.stdout:client4549 2023-11-24T06:14:04.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:04.929 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/2a42eb6f-5aad-4f8e-8067-d72b439cd81f.client4549/status') 2023-11-24T06:14:05.009 INFO:teuthology.orchestra.run.smithi176.stdout:instance: client.4549 (3)192.168.0.2:0/2034335595 2023-11-24T06:14:05.009 INFO:teuthology.orchestra.run.smithi176.stdout:blocklisted: false 2023-11-24T06:14:05.009 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records in 2023-11-24T06:14:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:0+1 records out 2023-11-24T06:14:05.010 INFO:teuthology.orchestra.run.smithi176.stderr:69 bytes copied, 2.198e-05 s, 3.1 MB/s 2023-11-24T06:14:05.011 INFO:teuthology.run_tasks:Running task check-counter... 2023-11-24T06:14:05.021 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-24T06:14:05.043 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:05.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.179+0000 7ff1ec4f1700 1 Processor -- start 2023-11-24T06:14:05.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.179+0000 7ff1ec4f1700 1 -- start start 2023-11-24T06:14:05.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1ec4f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1e40b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1ec4f1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff1e406c710 0x7ff1e40afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1ec4f1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1e40ae430 con 0x7ff1e40af4d0 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1ec4f1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1e40af0b0 con 0x7ff1e406c710 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1ec4f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b05a0 con 0x7ff1e415e080 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1e9a8c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff1e40af4d0 0x7ff1e406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38806/0 (socket says 172.21.15.106:38806) 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.180+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/2633009450 learned_addr learned my addr 172.21.15.106:0/2633009450 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1ea28d700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1e40b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1eaa8e700 1 --2- 172.21.15.106:0/2633009450 >> v2:172.21.15.176:3300/0 conn(0x7ff1e406c710 0x7ff1e40afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138487332 0 0) 0x7ff1e40ae430 con 0x7ff1e40af4d0 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1d00035b0 con 0x7ff1e40af4d0 2023-11-24T06:14:05.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1239513391 0 0) 0x7ff1d00035b0 con 0x7ff1e40af4d0 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 msgr2=0x7ff1e40b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1e40b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 >> v2:172.21.15.176:3300/0 conn(0x7ff1e406c710 msgr2=0x7ff1e40afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 --2- 172.21.15.106:0/2633009450 >> v2:172.21.15.176:3300/0 conn(0x7ff1e406c710 0x7ff1e40afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e40ae710 con 0x7ff1e40af4d0 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7ff1e0001670 con 0x7ff1e40af4d0 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 >> v1:172.21.15.106:6789/0 conn(0x7ff1e40af4d0 legacy=0x7ff1e406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0003a30 0x7ff1d0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1d0004850 0x7ff1d0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1d0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40af0b0 con 0x7ff1d0004850 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e40b05a0 con 0x7ff1d0003a30 2023-11-24T06:14:05.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1d000ba10 con 0x7ff1e415e080 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1eaa8e700 1 --2- 172.21.15.106:0/2633009450 >> v2:172.21.15.176:3300/0 conn(0x7ff1e406c710 0x7ff1e40afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1d0004850 0x7ff1d0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1ea28d700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0003a30 0x7ff1d0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1eaa8e700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1d0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 msgr2=0x7ff1d0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e415e080 0x7ff1d0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0003a30 msgr2=0x7ff1d0003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0003a30 0x7ff1d0003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.181+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/2633009450 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1d00035b0 con 0x7ff1d0004850 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1d0004850 0x7ff1d0004cd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c210 tx=0x7ff1d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a95a30c41b0e409 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007c10 con 0x7ff1d0004850 2023-11-24T06:14:05.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e000cdd0 con 0x7ff1d0004850 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1e928b700 1 -- 172.21.15.106:0/2633009450 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0005ba0 con 0x7ff1d0004850 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/2633009450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1d0004850 msgr2=0x7ff1d0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/2633009450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1d0004850 0x7ff1d0004cd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c210 tx=0x7ff1d0005880 comp rx=0 tx=0).stop 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1eaa8e700 1 -- 172.21.15.106:0/2633009450 reap_dead start 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/2633009450 shutdown_connections 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/2633009450 >> 172.21.15.106:0/2633009450 conn(0x7ff1e4071b90 msgr2=0x7ff1e4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/2633009450 shutdown_connections 2023-11-24T06:14:05.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.182+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/2633009450 wait complete. 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 Processor -- start 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 -- start start 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0004850 0x7ff1e41f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e41581a0 0x7ff1e4155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e4152fd0 con 0x7ff1e4149610 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e415f750 con 0x7ff1d0004850 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.184+0000 7ff1ec4f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e415fa30 con 0x7ff1e41581a0 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58558/0 (socket says 172.21.15.106:58558) 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/3169121943 learned_addr learned my addr 172.21.15.106:0/3169121943 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1eaa8e700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e41581a0 0x7ff1e4155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1ea28d700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0004850 0x7ff1e41f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e41581a0 msgr2=0x7ff1e4155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e41581a0 0x7ff1e4155330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0004850 msgr2=0x7ff1e41f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0004850 0x7ff1e41f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 -- 172.21.15.106:0/3169121943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e415fd10 con 0x7ff1e4149610 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1e9a8c700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c800 tx=0x7ff1e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0001630 con 0x7ff1e4149610 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e00070d0 con 0x7ff1e4149610 2023-11-24T06:14:05.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e415fff0 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0007480 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.185+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e41f40f0 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.186+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e40753f0 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.187+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff1e0019030 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.187+0000 7ff1daffd700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.187+0000 7ff1ea28d700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.187+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1e008a430 con 0x7ff1e4149610 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.188+0000 7ff1ea28d700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 0x7ff1c806d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4156b10 tx=0x7ff1d4009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.192+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff1e0055570 con 0x7ff1e4149610 2023-11-24T06:14:05.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.384+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1e4152fd0 con 0x7ff1e4149610 2023-11-24T06:14:05.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.385+0000 7ff1daffd700 1 -- 172.21.15.106:0/3169121943 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7ff1e0058b90 con 0x7ff1e4149610 2023-11-24T06:14:05.388 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:05.388 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 msgr2=0x7ff1c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 0x7ff1c806d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4156b10 tx=0x7ff1d4009210 comp rx=0 tx=0).stop 2023-11-24T06:14:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 msgr2=0x7ff1e4157c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff1e000c800 tx=0x7ff1e0001a00 comp rx=0 tx=0).stop 2023-11-24T06:14:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 shutdown_connections 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff1e41581a0 0x7ff1e4155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff1d0004850 0x7ff1e41f3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 --2- 172.21.15.106:0/3169121943 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1e4149610 0x7ff1e4157c60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 >> 172.21.15.106:0/3169121943 conn(0x7ff1e4071b90 msgr2=0x7ff1e40b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 shutdown_connections 2023-11-24T06:14:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.387+0000 7ff1ec4f1700 1 -- 172.21.15.106:0/3169121943 wait complete. 2023-11-24T06:14:05.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:05.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.523+0000 7f1c7d497700 1 Processor -- start 2023-11-24T06:14:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.523+0000 7f1c7d497700 1 -- start start 2023-11-24T06:14:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c7d497700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c7815e140 0x7f1c780d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c7d497700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c780d39d0 0x7f1c780d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c7d497700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c780b80e0 con 0x7f1c780b98c0 2023-11-24T06:14:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c7d497700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c7815e520 con 0x7f1c780d39d0 2023-11-24T06:14:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c7d497700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780d2930 con 0x7f1c7815e140 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c780d39d0 0x7f1c780d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c777fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1c780b98c0 0x7f1c780b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38830/0 (socket says 172.21.15.106:38830) 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c777fe700 1 -- 172.21.15.106:0/3842744692 learned_addr learned my addr 172.21.15.106:0/3842744692 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c76ffd700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c7815e140 0x7f1c780d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 -- 172.21.15.106:0/3842744692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c7815e140 msgr2=0x7f1c780d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c7815e140 0x7f1c780d3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 -- 172.21.15.106:0/3842744692 >> v1:172.21.15.106:6789/0 conn(0x7f1c780b98c0 legacy=0x7f1c780b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 -- 172.21.15.106:0/3842744692 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c780d2c10 con 0x7f1c780d39d0 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c75ffb700 1 -- 172.21.15.106:0/3842744692 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957452159 0 0) 0x7f1c70001490 con 0x7f1c780b98c0 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.524+0000 7f1c767fc700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780d39d0 0x7f1c780d4400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009840 tx=0x7f1c68009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=445b6d160b411713 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c75ffb700 1 -- 172.21.15.106:0/3842744692 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011830 con 0x7f1c780d39d0 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c75ffb700 1 -- 172.21.15.106:0/3842744692 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c68011990 con 0x7f1c780d39d0 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c75ffb700 1 -- 172.21.15.106:0/3842744692 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c68011d20 con 0x7f1c780d39d0 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 -- 172.21.15.106:0/3842744692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780d39d0 msgr2=0x7f1c780d4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780d39d0 0x7f1c780d4400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009840 tx=0x7f1c68009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 -- 172.21.15.106:0/3842744692 shutdown_connections 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c7815e140 0x7f1c780d3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 --2- 172.21.15.106:0/3842744692 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780d39d0 0x7f1c780d4400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 -- 172.21.15.106:0/3842744692 >> 172.21.15.106:0/3842744692 conn(0x7f1c7806b410 msgr2=0x7f1c7806b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 -- 172.21.15.106:0/3842744692 shutdown_connections 2023-11-24T06:14:05.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.525+0000 7f1c7d497700 1 -- 172.21.15.106:0/3842744692 wait complete. 2023-11-24T06:14:05.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.526+0000 7f1c7d497700 1 Processor -- start 2023-11-24T06:14:05.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 -- start start 2023-11-24T06:14:05.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780d39d0 0x7f1c780cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7815e140 0x7f1c780cb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780ca630 con 0x7f1c780b98c0 2023-11-24T06:14:05.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780cc830 con 0x7f1c7815e140 2023-11-24T06:14:05.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c7d497700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c780cbba0 con 0x7f1c780d39d0 2023-11-24T06:14:05.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c76ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c76ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58570/0 (socket says 172.21.15.106:58570) 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.527+0000 7f1c76ffd700 1 -- 172.21.15.106:0/83355388 learned_addr learned my addr 172.21.15.106:0/83355388 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c777fe700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7815e140 0x7f1c780cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c767fc700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780d39d0 0x7f1c780cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 -- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780d39d0 msgr2=0x7f1c780cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780d39d0 0x7f1c780cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 -- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7815e140 msgr2=0x7f1c780cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7815e140 0x7f1c780cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 -- 172.21.15.106:0/83355388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680094a0 con 0x7f1c780b98c0 2023-11-24T06:14:05.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c76ffd700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00d800 tx=0x7f1c6c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c0125f0 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6c012750 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c012b00 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c780cbe80 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.528+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c780cc160 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.529+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c780cc2f0 con 0x7f1c780b98c0 2023-11-24T06:14:05.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.529+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c6c012c60 con 0x7f1c780b98c0 2023-11-24T06:14:05.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.530+0000 7f1c5f7fe700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 0x7f1c6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.530+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c6c089980 con 0x7f1c780b98c0 2023-11-24T06:14:05.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.530+0000 7f1c767fc700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 0x7f1c6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.530+0000 7f1c767fc700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 0x7f1c6406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c680090b0 tx=0x7f1c68008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.534+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c6c054a30 con 0x7f1c780b98c0 2023-11-24T06:14:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.722+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c78068fb0 con 0x7f1c780b98c0 2023-11-24T06:14:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.723+0000 7f1c5f7fe700 1 -- 172.21.15.106:0/83355388 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c6c058050 con 0x7f1c780b98c0 2023-11-24T06:14:05.725 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.724+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 msgr2=0x7f1c6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.724+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 0x7f1c6406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1c680090b0 tx=0x7f1c68008030 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.724+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 msgr2=0x7f1c78160250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.724+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00d800 tx=0x7f1c6c00dbc0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 shutdown_connections 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c6406aed0 0x7f1c6406d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c7815e140 0x7f1c780cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c780b98c0 0x7f1c78160250 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 --2- 172.21.15.106:0/83355388 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c780d39d0 0x7f1c780cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 >> 172.21.15.106:0/83355388 conn(0x7f1c7806b410 msgr2=0x7f1c780d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 shutdown_connections 2023-11-24T06:14:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.725+0000 7f1c7d497700 1 -- 172.21.15.106:0/83355388 wait complete. 2023-11-24T06:14:05.739 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:05.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.862+0000 7f7f7f40b700 1 Processor -- start 2023-11-24T06:14:05.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.862+0000 7f7f7f40b700 1 -- start start 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7f40b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 0x7f7f780ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7f40b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 0x7f7f780cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7f40b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f780d0140 con 0x7f7f780cf1f0 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7f40b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f7815c330 con 0x7f7f780ce830 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7f40b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f780d03e0 con 0x7f7f7815bf50 2023-11-24T06:14:05.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d9a8700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7f780cf1f0 0x7f7f780c5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38844/0 (socket says 172.21.15.106:38844) 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d9a8700 1 -- 172.21.15.106:0/1248364372 learned_addr learned my addr 172.21.15.106:0/1248364372 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7c9a6700 1 --2- 172.21.15.106:0/1248364372 >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 0x7f7f780cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/1248364372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 0x7f7f780ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f6ffff700 1 -- 172.21.15.106:0/1248364372 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604327179 0 0) 0x7f7f780d0140 con 0x7f7f780cf1f0 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f6ffff700 1 -- 172.21.15.106:0/1248364372 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f640035b0 con 0x7f7f780cf1f0 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d1a7700 1 -- 172.21.15.106:0/1248364372 >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 msgr2=0x7f7f780cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/1248364372 >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 0x7f7f780cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d1a7700 1 -- 172.21.15.106:0/1248364372 >> v1:172.21.15.106:6789/0 conn(0x7f7f780cf1f0 legacy=0x7f7f780c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7d1a7700 1 -- 172.21.15.106:0/1248364372 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f780d06c0 con 0x7f7f7815bf50 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.863+0000 7f7f7c9a6700 1 --2- 172.21.15.106:0/1248364372 >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 0x7f7f780cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/1248364372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 0x7f7f780ce2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009840 tx=0x7f7f74009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e6d11db1bd9473 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f6ffff700 1 -- 172.21.15.106:0/1248364372 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74011830 con 0x7f7f7815bf50 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f6ffff700 1 -- 172.21.15.106:0/1248364372 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f74011990 con 0x7f7f7815bf50 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f6ffff700 1 -- 172.21.15.106:0/1248364372 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f74011d00 con 0x7f7f7815bf50 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 -- 172.21.15.106:0/1248364372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 msgr2=0x7f7f780ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/1248364372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 0x7f7f780ce2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7f74009840 tx=0x7f7f74009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 -- 172.21.15.106:0/1248364372 shutdown_connections 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/1248364372 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f7815bf50 0x7f7f780ce2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/1248364372 >> v2:172.21.15.176:3300/0 conn(0x7f7f780ce830 0x7f7f780cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 -- 172.21.15.106:0/1248364372 >> 172.21.15.106:0/1248364372 conn(0x7f7f780b3780 msgr2=0x7f7f780b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 -- 172.21.15.106:0/1248364372 shutdown_connections 2023-11-24T06:14:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.864+0000 7f7f7f40b700 1 -- 172.21.15.106:0/1248364372 wait complete. 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 Processor -- start 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 -- start start 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 0x7f7f7806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f780cf1f0 0x7f7f7806cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806b680 con 0x7f7f7815bf50 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806b960 con 0x7f7f780ce830 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7f40b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7806bc40 con 0x7f7f780cf1f0 2023-11-24T06:14:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7d9a8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7d9a8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58588/0 (socket says 172.21.15.106:58588) 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.866+0000 7f7f7d9a8700 1 -- 172.21.15.106:0/4173389245 learned_addr learned my addr 172.21.15.106:0/4173389245 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 0x7f7f7806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7c9a6700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f780cf1f0 0x7f7f7806cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 -- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f780cf1f0 msgr2=0x7f7f7806cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f780cf1f0 0x7f7f7806cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 -- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 msgr2=0x7f7f7806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 0x7f7f7806aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 -- 172.21.15.106:0/4173389245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f680094a0 con 0x7f7f7815bf50 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 0x7f7f7806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7d9a8700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000cb40 tx=0x7f7f7000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ab50 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f7000acb0 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f740094a0 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f70012620 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.867+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7806c200 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.868+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7806c3c0 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.869+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7f7001b3b0 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.869+0000 7f7f6dffb700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.869+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f700893d0 con 0x7f7f7815bf50 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.869+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.869+0000 7f7f7d1a7700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 0x7f7f5c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7f740090b0 tx=0x7f7f74008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:05.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:05.873+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7f70054480 con 0x7f7f7815bf50 2023-11-24T06:14:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.067+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f78068fb0 con 0x7f7f7815bf50 2023-11-24T06:14:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.068+0000 7f7f6dffb700 1 -- 172.21.15.106:0/4173389245 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f70057aa0 con 0x7f7f7815bf50 2023-11-24T06:14:06.071 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 msgr2=0x7f7f5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 0x7f7f5c06d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7f740090b0 tx=0x7f7f74008030 comp rx=0 tx=0).stop 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 msgr2=0x7f7f780c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000cb40 tx=0x7f7f7000cf00 comp rx=0 tx=0).stop 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 shutdown_connections 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7f5c06aed0 0x7f7f5c06d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f7815bf50 0x7f7f780c5df0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7f780ce830 0x7f7f7806aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 --2- 172.21.15.106:0/4173389245 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7f780cf1f0 0x7f7f7806cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 >> 172.21.15.106:0/4173389245 conn(0x7f7f780b3780 msgr2=0x7f7f780cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 shutdown_connections 2023-11-24T06:14:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.070+0000 7f7f7f40b700 1 -- 172.21.15.106:0/4173389245 wait complete. 2023-11-24T06:14:06.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:06.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.205+0000 7f5ada2c5700 1 Processor -- start 2023-11-24T06:14:06.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.205+0000 7f5ada2c5700 1 -- start start 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5ad415f500 0x7f5ad406fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5ad4070b40 0x7f5ad406ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad40cc580 0x7f5ad406f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40703a0 con 0x7f5ad4070b40 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad4070820 con 0x7f5ad415f500 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ada2c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad406fb80 con 0x7f5ad40cc580 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ad37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5ad4070b40 0x7f5ad406ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ad37fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5ad4070b40 0x7f5ad406ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58596/0 (socket says 172.21.15.106:58596) 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.206+0000 7f5ad37fe700 1 -- 172.21.15.106:0/4166320028 learned_addr learned my addr 172.21.15.106:0/4166320028 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad3fff700 1 --2- 172.21.15.106:0/4166320028 >> v2:172.21.15.176:3300/0 conn(0x7f5ad415f500 0x7f5ad406fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad8862700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad40cc580 0x7f5ad406f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 -- 172.21.15.106:0/4166320028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad40cc580 msgr2=0x7f5ad406f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad40cc580 0x7f5ad406f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 -- 172.21.15.106:0/4166320028 >> v2:172.21.15.176:3300/0 conn(0x7f5ad415f500 msgr2=0x7f5ad406fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/4166320028 >> v2:172.21.15.176:3300/0 conn(0x7f5ad415f500 0x7f5ad406fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 -- 172.21.15.106:0/4166320028 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad40d0260 con 0x7f5ad4070b40 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad4070b40 0x7f5ad406ed70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40d2ce0 tx=0x7f5ac4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2880675aea021e26 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad2ffd700 1 -- 172.21.15.106:0/4166320028 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400b870 con 0x7f5ad4070b40 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad2ffd700 1 -- 172.21.15.106:0/4166320028 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac400b9d0 con 0x7f5ad4070b40 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.207+0000 7f5ad2ffd700 1 -- 172.21.15.106:0/4166320028 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac400bd60 con 0x7f5ad4070b40 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 -- 172.21.15.106:0/4166320028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad4070b40 msgr2=0x7f5ad406ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad4070b40 0x7f5ad406ed70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40d2ce0 tx=0x7f5ac4009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 -- 172.21.15.106:0/4166320028 shutdown_connections 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad40cc580 0x7f5ad406f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/4166320028 >> v2:172.21.15.176:3300/0 conn(0x7f5ad415f500 0x7f5ad406fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/4166320028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad4070b40 0x7f5ad406ed70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 -- 172.21.15.106:0/4166320028 >> 172.21.15.106:0/4166320028 conn(0x7f5ad40b3710 msgr2=0x7f5ad40b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 -- 172.21.15.106:0/4166320028 shutdown_connections 2023-11-24T06:14:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.208+0000 7f5ada2c5700 1 -- 172.21.15.106:0/4166320028 wait complete. 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.209+0000 7f5ada2c5700 1 Processor -- start 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.209+0000 7f5ada2c5700 1 -- start start 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad4070b40 0x7f5ad4159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ad415f500 0x7f5ad40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b5f90 con 0x7f5ad40cc580 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad41597c0 con 0x7f5ad415f500 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ada2c5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad40b13e0 con 0x7f5ad4070b40 2023-11-24T06:14:06.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58600/0 (socket says 172.21.15.106:58600) 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 -- 172.21.15.106:0/1793841633 learned_addr learned my addr 172.21.15.106:0/1793841633 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad8862700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ad415f500 0x7f5ad40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad3fff700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad4070b40 0x7f5ad4159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 -- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad4070b40 msgr2=0x7f5ad4159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad4070b40 0x7f5ad4159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 -- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ad415f500 msgr2=0x7f5ad40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ad415f500 0x7f5ad40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 -- 172.21.15.106:0/1793841633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4009550 con 0x7f5ad40cc580 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.210+0000 7f5ad37fe700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4014040 tx=0x7f5ac4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.211+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4011830 con 0x7f5ad40cc580 2023-11-24T06:14:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.211+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac401e070 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.211+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad40b5940 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.211+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4011bd0 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.211+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad40b77b0 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.212+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad40b6100 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.212+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5ac4011d30 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.212+0000 7f5ad0ff9700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 0x7f5ac006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.212+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5ac4020070 con 0x7f5ad40cc580 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.212+0000 7f5ad3fff700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 0x7f5ac006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.213+0000 7f5ad3fff700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 0x7f5ac006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ab60 tx=0x7f5ac8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.217+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5ac4055c30 con 0x7f5ad40cc580 2023-11-24T06:14:06.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.408+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ad4068fb0 con 0x7f5ad40cc580 2023-11-24T06:14:06.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.409+0000 7f5ad0ff9700 1 -- 172.21.15.106:0/1793841633 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5ac4059250 con 0x7f5ad40cc580 2023-11-24T06:14:06.412 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 msgr2=0x7f5ac006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 0x7f5ac006d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800ab60 tx=0x7f5ac8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 msgr2=0x7f5ad40c8cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4014040 tx=0x7f5ac4004750 comp rx=0 tx=0).stop 2023-11-24T06:14:06.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 shutdown_connections 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ac006aed0 0x7f5ac006d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ad415f500 0x7f5ad40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ad4070b40 0x7f5ad4159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 --2- 172.21.15.106:0/1793841633 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad40cc580 0x7f5ad40c8cb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 >> 172.21.15.106:0/1793841633 conn(0x7f5ad40b3710 msgr2=0x7f5ad40af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 shutdown_connections 2023-11-24T06:14:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.411+0000 7f5ada2c5700 1 -- 172.21.15.106:0/1793841633 wait complete. 2023-11-24T06:14:06.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:06.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.543+0000 7f32b0a33700 1 Processor -- start 2023-11-24T06:14:06.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.543+0000 7f32b0a33700 1 -- start start 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.544+0000 7f32b0a33700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32ac15ddd0 0x7f32ac0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.544+0000 7f32b0a33700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0b1d40 con 0x7f32ac15e1b0 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.544+0000 7f32b0a33700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ac0b28c0 con 0x7f32ac0d2240 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.544+0000 7f32b0a33700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ac0b1f90 con 0x7f32ac15ddd0 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.544+0000 7f32aa59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f32ac15ddd0 0x7f32ac0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a9d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f32ac15e1b0 0x7f32ac0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38870/0 (socket says 172.21.15.106:38870) 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a9d9b700 1 -- 172.21.15.106:0/2008639937 learned_addr learned my addr 172.21.15.106:0/2008639937 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32aa59c700 1 -- 172.21.15.106:0/2008639937 >> v1:172.21.15.176:6789/0 conn(0x7f32ac0d2240 legacy=0x7f32ac06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32aa59c700 1 -- 172.21.15.106:0/2008639937 >> v1:172.21.15.106:6789/0 conn(0x7f32ac15e1b0 legacy=0x7f32ac0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a959a700 1 -- 172.21.15.106:0/2008639937 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2189865046 0 0) 0x7f32ac0b1d40 con 0x7f32ac15e1b0 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32aa59c700 1 -- 172.21.15.106:0/2008639937 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ac0b2270 con 0x7f32ac15ddd0 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32aa59c700 1 --2- 172.21.15.106:0/2008639937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac15ddd0 0x7f32ac0b1680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009870 tx=0x7f32a0009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a58dc31b682555 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a959a700 1 -- 172.21.15.106:0/2008639937 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0004230 con 0x7f32ac15ddd0 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a959a700 1 -- 172.21.15.106:0/2008639937 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0004390 con 0x7f32ac15ddd0 2023-11-24T06:14:06.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.545+0000 7f32a959a700 1 -- 172.21.15.106:0/2008639937 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00036a0 con 0x7f32ac15ddd0 2023-11-24T06:14:06.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 -- 172.21.15.106:0/2008639937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac15ddd0 msgr2=0x7f32ac0b1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 --2- 172.21.15.106:0/2008639937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac15ddd0 0x7f32ac0b1680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32a0009870 tx=0x7f32a0009b80 comp rx=0 tx=0).stop 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 -- 172.21.15.106:0/2008639937 shutdown_connections 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 --2- 172.21.15.106:0/2008639937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac15ddd0 0x7f32ac0b1680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 -- 172.21.15.106:0/2008639937 >> 172.21.15.106:0/2008639937 conn(0x7f32ac0731a0 msgr2=0x7f32ac09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 -- 172.21.15.106:0/2008639937 shutdown_connections 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.546+0000 7f32b0a33700 1 -- 172.21.15.106:0/2008639937 wait complete. 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.547+0000 7f32b0a33700 1 Processor -- start 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.547+0000 7f32b0a33700 1 -- start start 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac15ddd0 0x7f32ac14c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac15e1b0 0x7f32ac15bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac14c6f0 con 0x7f32ac0d2240 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac156710 con 0x7f32ac15e1b0 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32b0a33700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ac155b00 con 0x7f32ac15ddd0 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58612/0 (socket says 172.21.15.106:58612) 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 -- 172.21.15.106:0/557241094 learned_addr learned my addr 172.21.15.106:0/557241094 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32a9d9b700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac15ddd0 0x7f32ac14c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aad9d700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac15e1b0 0x7f32ac15bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 -- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac15ddd0 msgr2=0x7f32ac14c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac15ddd0 0x7f32ac14c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 -- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac15e1b0 msgr2=0x7f32ac15bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac15e1b0 0x7f32ac15bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 -- 172.21.15.106:0/557241094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a00094a0 con 0x7f32ac0d2240 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.548+0000 7f32aa59c700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000c00 tx=0x7f32a0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.549+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0011630 con 0x7f32ac0d2240 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.549+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a001e070 con 0x7f32ac0d2240 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.549+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ac0b2ed0 con 0x7f32ac0d2240 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.549+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a00119d0 con 0x7f32ac0d2240 2023-11-24T06:14:06.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.549+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ac1560c0 con 0x7f32ac0d2240 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.550+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ac067f60 con 0x7f32ac0d2240 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.550+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32a0011b30 con 0x7f32ac0d2240 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.550+0000 7f329affd700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 0x7f328c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.550+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32a008a900 con 0x7f32ac0d2240 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.551+0000 7f32a9d9b700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 0x7f328c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.551+0000 7f32a9d9b700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 0x7f328c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15ce40 tx=0x7f329c007e70 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.555+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32a00559c0 con 0x7f32ac0d2240 2023-11-24T06:14:06.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.746+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32ac0b7c60 con 0x7f32ac0d2240 2023-11-24T06:14:06.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.747+0000 7f329affd700 1 -- 172.21.15.106:0/557241094 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f32a0020090 con 0x7f32ac0d2240 2023-11-24T06:14:06.750 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:06.751 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:06.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 msgr2=0x7f328c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 0x7f328c06d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f32ac15ce40 tx=0x7f329c007e70 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 msgr2=0x7f32ac156ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f32a0000c00 tx=0x7f32a0004750 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 shutdown_connections 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f328c06aed0 0x7f328c06d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f32ac15e1b0 0x7f32ac15bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f32ac0d2240 0x7f32ac156ba0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 --2- 172.21.15.106:0/557241094 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f32ac15ddd0 0x7f32ac14c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.749+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 >> 172.21.15.106:0/557241094 conn(0x7f32ac0731a0 msgr2=0x7f32ac160ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.750+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 shutdown_connections 2023-11-24T06:14:06.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.750+0000 7f32b0a33700 1 -- 172.21.15.106:0/557241094 wait complete. 2023-11-24T06:14:06.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:06.765 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:06.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.885+0000 7fe5b5755700 1 Processor -- start 2023-11-24T06:14:06.888 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.885+0000 7fe5b5755700 1 -- start start 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5b5755700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5b015e140 0x7fe5b00d3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5b5755700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00b80e0 con 0x7fe5b00d39d0 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5b5755700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00b67d0 con 0x7fe5b00b98c0 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5b5755700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b015e520 con 0x7fe5b015e140 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5aeffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe5b015e140 0x7fe5b00d3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5ae7fc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe5b00d39d0 0x7fe5b00b59b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38882/0 (socket says 172.21.15.106:38882) 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5ae7fc700 1 -- 172.21.15.106:0/3519161080 learned_addr learned my addr 172.21.15.106:0/3519161080 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5aeffd700 1 -- 172.21.15.106:0/3519161080 >> v1:172.21.15.176:6789/0 conn(0x7fe5b00b98c0 legacy=0x7fe5b00b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5aeffd700 1 -- 172.21.15.106:0/3519161080 >> v1:172.21.15.106:6789/0 conn(0x7fe5b00d39d0 legacy=0x7fe5b00b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5aeffd700 1 -- 172.21.15.106:0/3519161080 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b00d2930 con 0x7fe5b015e140 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5adffb700 1 -- 172.21.15.106:0/3519161080 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742757500 0 0) 0x7fe5a0001110 con 0x7fe5b00d39d0 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5aeffd700 1 --2- 172.21.15.106:0/3519161080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b00d3ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009840 tx=0x7fe5a4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d81042dcc708847 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5adffb700 1 -- 172.21.15.106:0/3519161080 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a4004230 con 0x7fe5b015e140 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5adffb700 1 -- 172.21.15.106:0/3519161080 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a4004390 con 0x7fe5b015e140 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.886+0000 7fe5adffb700 1 -- 172.21.15.106:0/3519161080 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a40036a0 con 0x7fe5b015e140 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 -- 172.21.15.106:0/3519161080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 msgr2=0x7fe5b00d3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 --2- 172.21.15.106:0/3519161080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b00d3ec0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4009840 tx=0x7fe5a4009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 -- 172.21.15.106:0/3519161080 shutdown_connections 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 --2- 172.21.15.106:0/3519161080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b00d3ec0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 -- 172.21.15.106:0/3519161080 >> 172.21.15.106:0/3519161080 conn(0x7fe5b006b410 msgr2=0x7fe5b006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 -- 172.21.15.106:0/3519161080 shutdown_connections 2023-11-24T06:14:06.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.887+0000 7fe5b5755700 1 -- 172.21.15.106:0/3519161080 wait complete. 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.889+0000 7fe5b5755700 1 Processor -- start 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.889+0000 7fe5b5755700 1 -- start start 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5b00b98c0 0x7fe5b0157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5b00d39d0 0x7fe5b00cd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00c8150 con 0x7fe5b015e140 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0161000 con 0x7fe5b00d39d0 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00c83a0 con 0x7fe5b00b98c0 2023-11-24T06:14:06.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58628/0 (socket says 172.21.15.106:58628) 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 -- 172.21.15.106:0/806468745 learned_addr learned my addr 172.21.15.106:0/806468745 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5ae7fc700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5b00d39d0 0x7fe5b00cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5aeffd700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5b00b98c0 0x7fe5b0157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 -- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5b00b98c0 msgr2=0x7fe5b0157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5b00b98c0 0x7fe5b0157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 -- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5b00d39d0 msgr2=0x7fe5b00cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5b00d39d0 0x7fe5b00cd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 -- 172.21.15.106:0/806468745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a40094a0 con 0x7fe5b015e140 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5af7fe700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800b970 tx=0x7fe5a800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800c9b0 con 0x7fe5b015e140 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800cb10 con 0x7fe5b015e140 2023-11-24T06:14:06.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b00c8680 con 0x7fe5b015e140 2023-11-24T06:14:06.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8014440 con 0x7fe5b015e140 2023-11-24T06:14:06.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.890+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b01541c0 con 0x7fe5b015e140 2023-11-24T06:14:06.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.891+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b0068fb0 con 0x7fe5b015e140 2023-11-24T06:14:06.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.892+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe5a801d3b0 con 0x7fe5b015e140 2023-11-24T06:14:06.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.892+0000 7fe5977fe700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:06.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.892+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5a80892f0 con 0x7fe5b015e140 2023-11-24T06:14:06.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.892+0000 7fe5aeffd700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:06.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.893+0000 7fe5aeffd700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 0x7fe59c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a401c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:06.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:06.897+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe5a8054310 con 0x7fe5b015e140 2023-11-24T06:14:07.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.083+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe5b00b8320 con 0x7fe5b015e140 2023-11-24T06:14:07.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.083+0000 7fe5977fe700 1 -- 172.21.15.106:0/806468745 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe5a8057930 con 0x7fe5b015e140 2023-11-24T06:14:07.087 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 msgr2=0x7fe59c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 0x7fe59c06d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe5a4000c00 tx=0x7fe5a401c040 comp rx=0 tx=0).stop 2023-11-24T06:14:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 msgr2=0x7fe5b01532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe5a800b970 tx=0x7fe5a800bd30 comp rx=0 tx=0).stop 2023-11-24T06:14:07.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 shutdown_connections 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe59c06aed0 0x7fe59c06d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5b015e140 0x7fe5b01532e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe5b00b98c0 0x7fe5b0157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 --2- 172.21.15.106:0/806468745 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe5b00d39d0 0x7fe5b00cd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 >> 172.21.15.106:0/806468745 conn(0x7fe5b006b410 msgr2=0x7fe5b00b8840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 shutdown_connections 2023-11-24T06:14:07.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.085+0000 7fe5b5755700 1 -- 172.21.15.106:0/806468745 wait complete. 2023-11-24T06:14:07.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 Processor -- start 2023-11-24T06:14:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 -- start start 2023-11-24T06:14:07.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f056815bf50 0x7f05680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f05680ce830 0x7f05680cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05680d0140 con 0x7f05680cf1f0 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056815c330 con 0x7f056815bf50 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056ee37700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05680d03e0 con 0x7f05680ce830 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.221+0000 7f056cbd3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f056815bf50 0x7f05680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f056815bf50 0x7f05680ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58636/0 (socket says 172.21.15.106:58636) 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 -- 172.21.15.106:0/3544340470 learned_addr learned my addr 172.21.15.106:0/3544340470 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f0567fff700 1 --2- 172.21.15.106:0/3544340470 >> v2:172.21.15.176:3300/0 conn(0x7f05680ce830 0x7f05680cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 -- 172.21.15.106:0/3544340470 >> v2:172.21.15.176:3300/0 conn(0x7f05680ce830 msgr2=0x7f05680cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 --2- 172.21.15.106:0/3544340470 >> v2:172.21.15.176:3300/0 conn(0x7f05680ce830 0x7f05680cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 -- 172.21.15.106:0/3544340470 >> v1:172.21.15.176:6789/0 conn(0x7f05680cf1f0 legacy=0x7f05680c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 -- 172.21.15.106:0/3544340470 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05680d06c0 con 0x7f056815bf50 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f056cbd3700 1 --2- 172.21.15.106:0/3544340470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f056815bf50 0x7f05680ce2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0568072420 tx=0x7f055c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824b98f75922ed97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f05677fe700 1 -- 172.21.15.106:0/3544340470 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c004230 con 0x7f056815bf50 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f05677fe700 1 -- 172.21.15.106:0/3544340470 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c004390 con 0x7f056815bf50 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.222+0000 7f05677fe700 1 -- 172.21.15.106:0/3544340470 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0036a0 con 0x7f056815bf50 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 -- 172.21.15.106:0/3544340470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f056815bf50 msgr2=0x7f05680ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 --2- 172.21.15.106:0/3544340470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f056815bf50 0x7f05680ce2f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0568072420 tx=0x7f055c009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 -- 172.21.15.106:0/3544340470 shutdown_connections 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 --2- 172.21.15.106:0/3544340470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f056815bf50 0x7f05680ce2f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 --2- 172.21.15.106:0/3544340470 >> v2:172.21.15.176:3300/0 conn(0x7f05680ce830 0x7f05680cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 -- 172.21.15.106:0/3544340470 >> 172.21.15.106:0/3544340470 conn(0x7f05680b3780 msgr2=0x7f05680b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 -- 172.21.15.106:0/3544340470 shutdown_connections 2023-11-24T06:14:07.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.223+0000 7f056ee37700 1 -- 172.21.15.106:0/3544340470 wait complete. 2023-11-24T06:14:07.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.224+0000 7f056ee37700 1 Processor -- start 2023-11-24T06:14:07.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.224+0000 7f056ee37700 1 -- start start 2023-11-24T06:14:07.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 0x7f05681e5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815bf50 0x7f056806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05681e6c60 con 0x7f05680cf1f0 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05681e70f0 con 0x7f056815bf50 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056ee37700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05681e6050 con 0x7f05680ce830 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58640/0 (socket says 172.21.15.106:58640) 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 -- 172.21.15.106:0/1676807235 learned_addr learned my addr 172.21.15.106:0/1676807235 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056d3d4700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815bf50 0x7f056806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056cbd3700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 0x7f05681e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 -- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 msgr2=0x7f05681e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 0x7f05681e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 -- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815bf50 msgr2=0x7f056806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815bf50 0x7f056806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 -- 172.21.15.106:0/1676807235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c009550 con 0x7f05680cf1f0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f056cbd3700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 0x7f05681e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f0567fff700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f055400e810 tx=0x7f055400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.225+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554013610 con 0x7f05680cf1f0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.226+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554013770 con 0x7f05680cf1f0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.226+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05681e6330 con 0x7f05680cf1f0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.226+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554013b20 con 0x7f05680cf1f0 2023-11-24T06:14:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.226+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05681e68f0 con 0x7f05680cf1f0 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.226+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05680d12f0 con 0x7f05680cf1f0 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.227+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0554013c80 con 0x7f05680cf1f0 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.227+0000 7f05657fa700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 0x7f054c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.227+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05540891e0 con 0x7f05680cf1f0 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.227+0000 7f056cbd3700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 0x7f054c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.228+0000 7f056cbd3700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 0x7f054c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f055c009130 tx=0x7f055c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.231+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05540542a0 con 0x7f05680cf1f0 2023-11-24T06:14:07.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.424+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f05681e6da0 con 0x7f05680cf1f0 2023-11-24T06:14:07.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.425+0000 7f05657fa700 1 -- 172.21.15.106:0/1676807235 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f05540578c0 con 0x7f05680cf1f0 2023-11-24T06:14:07.428 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 msgr2=0x7f054c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 0x7f054c06d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f055c009130 tx=0x7f055c008030 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 msgr2=0x7f056806b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f055400e810 tx=0x7f055400eb20 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 shutdown_connections 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f054c06aed0 0x7f054c06d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f056815bf50 0x7f056806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05680ce830 0x7f05681e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 --2- 172.21.15.106:0/1676807235 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05680cf1f0 0x7f056806b880 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 >> 172.21.15.106:0/1676807235 conn(0x7f05680b3780 msgr2=0x7f05680c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 shutdown_connections 2023-11-24T06:14:07.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.427+0000 7f056ee37700 1 -- 172.21.15.106:0/1676807235 wait complete. 2023-11-24T06:14:07.443 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:07.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.561+0000 7f2e82bc4700 1 Processor -- start 2023-11-24T06:14:07.565 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.562+0000 7f2e82bc4700 1 -- start start 2023-11-24T06:14:07.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.562+0000 7f2e82bc4700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2e7c0b4370 0x7f2e7c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.562+0000 7f2e82bc4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c0ae5e0 con 0x7f2e7c15b370 2023-11-24T06:14:07.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.562+0000 7f2e82bc4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7c15be30 con 0x7f2e7c1587f0 2023-11-24T06:14:07.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.562+0000 7f2e82bc4700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e7c15c110 con 0x7f2e7c0b4370 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2e7c0b4370 0x7f2e7c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2e7c0b4370 0x7f2e7c15b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58646/0 (socket says 172.21.15.106:58646) 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 -- 172.21.15.106:0/3559674389 learned_addr learned my addr 172.21.15.106:0/3559674389 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e7bfff700 1 --1- 172.21.15.106:0/3559674389 >> v1:172.21.15.106:6789/0 conn(0x7f2e7c15b370 0x7f2e7c0b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38908/0 (socket says 172.21.15.106:38908) 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 -- 172.21.15.106:0/3559674389 >> v1:172.21.15.176:6789/0 conn(0x7f2e7c1587f0 legacy=0x7f2e7c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 -- 172.21.15.106:0/3559674389 >> v1:172.21.15.106:6789/0 conn(0x7f2e7c15b370 legacy=0x7f2e7c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e7b7fe700 1 -- 172.21.15.106:0/3559674389 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822209790 0 0) 0x7f2e7c0ae5e0 con 0x7f2e7c15b370 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 -- 172.21.15.106:0/3559674389 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7c0ae860 con 0x7f2e7c0b4370 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e81161700 1 --2- 172.21.15.106:0/3559674389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c0b4370 0x7f2e7c15b800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d180 tx=0x7f2e7400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d52d4227c80b1db server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e7b7fe700 1 -- 172.21.15.106:0/3559674389 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74010070 con 0x7f2e7c0b4370 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e7b7fe700 1 -- 172.21.15.106:0/3559674389 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400dd70 con 0x7f2e7c0b4370 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.563+0000 7f2e7b7fe700 1 -- 172.21.15.106:0/3559674389 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400b310 con 0x7f2e7c0b4370 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 -- 172.21.15.106:0/3559674389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c0b4370 msgr2=0x7f2e7c15b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/3559674389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c0b4370 0x7f2e7c15b800 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400d180 tx=0x7f2e7400d490 comp rx=0 tx=0).stop 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 -- 172.21.15.106:0/3559674389 shutdown_connections 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/3559674389 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c0b4370 0x7f2e7c15b800 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 -- 172.21.15.106:0/3559674389 >> 172.21.15.106:0/3559674389 conn(0x7f2e7c0d0bf0 msgr2=0x7f2e7c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 -- 172.21.15.106:0/3559674389 shutdown_connections 2023-11-24T06:14:07.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.564+0000 7f2e82bc4700 1 -- 172.21.15.106:0/3559674389 wait complete. 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.565+0000 7f2e82bc4700 1 Processor -- start 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.565+0000 7f2e82bc4700 1 -- start start 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e7c0b4370 0x7f2e7c09dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e7c15b370 0x7f2e7c1557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c09cf10 con 0x7f2e7c1587f0 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c09d1f0 con 0x7f2e7c15b370 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e82bc4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7c09d4d0 con 0x7f2e7c0b4370 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58652/0 (socket says 172.21.15.106:58652) 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 -- 172.21.15.106:0/2064912084 learned_addr learned my addr 172.21.15.106:0/2064912084 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e81161700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e7c15b370 0x7f2e7c1557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 -- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e7c0b4370 msgr2=0x7f2e7c09dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e80960700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e7c0b4370 0x7f2e7c09dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e7c0b4370 0x7f2e7c09dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 -- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e7c15b370 msgr2=0x7f2e7c1557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e7c15b370 0x7f2e7c1557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.566+0000 7f2e7bfff700 1 -- 172.21.15.106:0/2064912084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7400bd40 con 0x7f2e7c1587f0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e7bfff700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c550 tx=0x7f2e6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68004c80 con 0x7f2e7c1587f0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68004e00 con 0x7f2e7c1587f0 2023-11-24T06:14:07.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e7c09d7b0 con 0x7f2e7c1587f0 2023-11-24T06:14:07.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68007310 con 0x7f2e7c1587f0 2023-11-24T06:14:07.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.567+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e7c15a840 con 0x7f2e7c1587f0 2023-11-24T06:14:07.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.568+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7c068fb0 con 0x7f2e7c1587f0 2023-11-24T06:14:07.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.568+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e68007470 con 0x7f2e7c1587f0 2023-11-24T06:14:07.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.569+0000 7f2e797fa700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 0x7f2e6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.569+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e68089370 con 0x7f2e7c1587f0 2023-11-24T06:14:07.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.569+0000 7f2e80960700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 0x7f2e6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.569+0000 7f2e80960700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 0x7f2e6006d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.573+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e68054380 con 0x7f2e7c1587f0 2023-11-24T06:14:07.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.763+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2e7c06ed30 con 0x7f2e7c1587f0 2023-11-24T06:14:07.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.764+0000 7f2e797fa700 1 -- 172.21.15.106:0/2064912084 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e680579a0 con 0x7f2e7c1587f0 2023-11-24T06:14:07.768 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 msgr2=0x7f2e6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 0x7f2e6006d390 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2e70007fd0 tx=0x7f2e70009040 comp rx=0 tx=0).stop 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 msgr2=0x7f2e7c155280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c550 tx=0x7f2e6800c910 comp rx=0 tx=0).stop 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 shutdown_connections 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2e6006aed0 0x7f2e6006d390 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2e7c15b370 0x7f2e7c1557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2e7c0b4370 0x7f2e7c09dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 --2- 172.21.15.106:0/2064912084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7c1587f0 0x7f2e7c155280 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 >> 172.21.15.106:0/2064912084 conn(0x7f2e7c0d0bf0 msgr2=0x7f2e7c06f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 shutdown_connections 2023-11-24T06:14:07.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.766+0000 7f2e82bc4700 1 -- 172.21.15.106:0/2064912084 wait complete. 2023-11-24T06:14:07.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.897+0000 7f61e5356700 1 Processor -- start 2023-11-24T06:14:07.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.897+0000 7f61e5356700 1 -- start start 2023-11-24T06:14:07.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61e5356700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f61e00af4d0 0x7f61e00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61e5356700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00ae430 con 0x7f61e015e080 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61e5356700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61e00ae710 con 0x7f61e006c710 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61e5356700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61e00af0b0 con 0x7f61e00af4d0 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61deffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f61e015e080 0x7f61e006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38920/0 (socket says 172.21.15.106:38920) 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.898+0000 7f61deffd700 1 -- 172.21.15.106:0/935041626 learned_addr learned my addr 172.21.15.106:0/935041626 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61df7fe700 1 --2- 172.21.15.106:0/935041626 >> v2:172.21.15.176:3300/0 conn(0x7f61e00af4d0 0x7f61e00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336706145 0 0) 0x7f61e00ae430 con 0x7f61e015e080 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61cc0035b0 con 0x7f61e015e080 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 20361450 0 0) 0x7f61cc0035b0 con 0x7f61e015e080 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 >> v2:172.21.15.176:3300/0 conn(0x7f61e00af4d0 msgr2=0x7f61e00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 --2- 172.21.15.106:0/935041626 >> v2:172.21.15.176:3300/0 conn(0x7f61e00af4d0 0x7f61e00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.905 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 >> v1:172.21.15.176:6789/0 conn(0x7f61e006c710 legacy=0x7f61e006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e00ae9f0 con 0x7f61e015e080 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f61c8001670 con 0x7f61e015e080 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 >> v1:172.21.15.106:6789/0 conn(0x7f61e015e080 legacy=0x7f61e006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc003a00 0x7f61cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 0x7f61cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61cc005210 0x7f61cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00af0b0 con 0x7f61cc004850 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc00c0b0 con 0x7f61cc005210 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc00c270 con 0x7f61cc003a00 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 0x7f61cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61deffd700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc003a00 0x7f61cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61df7fe700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61cc005210 0x7f61cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 -- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc003a00 msgr2=0x7f61cc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc003a00 0x7f61cc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 -- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61cc005210 msgr2=0x7f61cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61cc005210 0x7f61cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61df7fe700 1 -- 172.21.15.106:0/935041626 reap_dead start 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.899+0000 7f61de7fc700 1 -- 172.21.15.106:0/935041626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc0035b0 con 0x7f61cc004850 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61de7fc700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 0x7f61cc004cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f61d00017c0 tx=0x7f61cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd62d39791155a1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00052d0 con 0x7f61cc004850 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0005450 con 0x7f61cc004850 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61ddffb700 1 -- 172.21.15.106:0/935041626 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00038c0 con 0x7f61cc004850 2023-11-24T06:14:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 -- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 msgr2=0x7f61cc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 0x7f61cc004cd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f61d00017c0 tx=0x7f61cc005880 comp rx=0 tx=0).stop 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 -- 172.21.15.106:0/935041626 shutdown_connections 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 --2- 172.21.15.106:0/935041626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61cc004850 0x7f61cc004cd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 -- 172.21.15.106:0/935041626 >> 172.21.15.106:0/935041626 conn(0x7f61e0071b90 msgr2=0x7f61e0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 -- 172.21.15.106:0/935041626 shutdown_connections 2023-11-24T06:14:07.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.900+0000 7f61e5356700 1 -- 172.21.15.106:0/935041626 wait complete. 2023-11-24T06:14:07.910 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.902+0000 7f61e5356700 1 Processor -- start 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.902+0000 7f61e5356700 1 -- start start 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 0x7f61e0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61e0154770 0x7f61e0154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0155160 con 0x7f61e01605e0 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61e0160fa0 con 0x7f61e0154770 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61e5356700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61e00cf7b0 con 0x7f61cc004850 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58672/0 (socket says 172.21.15.106:58672) 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 -- 172.21.15.106:0/894717934 learned_addr learned my addr 172.21.15.106:0/894717934 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61df7fe700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61e0154770 0x7f61e0154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.911 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61deffd700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 0x7f61e0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 -- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 msgr2=0x7f61e0152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 0x7f61e0152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 -- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61e0154770 msgr2=0x7f61e0154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61e0154770 0x7f61e0154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61de7fc700 1 -- 172.21.15.106:0/894717934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e0155350 con 0x7f61e01605e0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.903+0000 7f61deffd700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 0x7f61e0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61de7fc700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000c00 tx=0x7f61d0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d0001290 con 0x7f61e01605e0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d0007040 con 0x7f61e01605e0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d00073f0 con 0x7f61e01605e0 2023-11-24T06:14:07.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61e0155630 con 0x7f61e01605e0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.904+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61e0155bf0 con 0x7f61e01605e0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.905+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61e00753f0 con 0x7f61e01605e0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.905+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61d0007550 con 0x7f61e01605e0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.905+0000 7f61d77fe700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 0x7f61c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.906+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61d0089ee0 con 0x7f61e01605e0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.906+0000 7f61deffd700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 0x7f61c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.906+0000 7f61deffd700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 0x7f61c006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:07.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:07.910+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61d0055140 con 0x7f61e01605e0 2023-11-24T06:14:08.103 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.099+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61e00afb90 con 0x7f61e01605e0 2023-11-24T06:14:08.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.100+0000 7f61d77fe700 1 -- 172.21.15.106:0/894717934 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f61d0021090 con 0x7f61e01605e0 2023-11-24T06:14:08.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:08.104 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 msgr2=0x7f61c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 0x7f61c006d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f61c8000c00 tx=0x7f61c8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 msgr2=0x7f61e0160a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f61d0000c00 tx=0x7f61d0001120 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 shutdown_connections 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61c006aed0 0x7f61c006d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61e0154770 0x7f61e0154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61cc004850 0x7f61e0152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 --2- 172.21.15.106:0/894717934 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61e01605e0 0x7f61e0160a60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 >> 172.21.15.106:0/894717934 conn(0x7f61e0071b90 msgr2=0x7f61e006f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 shutdown_connections 2023-11-24T06:14:08.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.103+0000 7f61e5356700 1 -- 172.21.15.106:0/894717934 wait complete. 2023-11-24T06:14:08.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:08.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:08.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.238+0000 7f0d85427700 1 Processor -- start 2023-11-24T06:14:08.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.238+0000 7f0d85427700 1 -- start start 2023-11-24T06:14:08.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d85427700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d800b5950 0x7f0d800b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d85427700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800d1aa0 con 0x7f0d8015e1d0 2023-11-24T06:14:08.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d85427700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d800b62a0 con 0x7f0d800cf240 2023-11-24T06:14:08.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d85427700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d800d3b40 con 0x7f0d800b5950 2023-11-24T06:14:08.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7f7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d800b5950 0x7f0d800b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7effd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0d8015e1d0 0x7f0d800d2ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38940/0 (socket says 172.21.15.106:38940) 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7effd700 1 -- 172.21.15.106:0/2141713102 learned_addr learned my addr 172.21.15.106:0/2141713102 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7f7fe700 1 -- 172.21.15.106:0/2141713102 >> v1:172.21.15.176:6789/0 conn(0x7f0d800cf240 legacy=0x7f0d800d3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7f7fe700 1 -- 172.21.15.106:0/2141713102 >> v1:172.21.15.106:6789/0 conn(0x7f0d8015e1d0 legacy=0x7f0d800d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7f7fe700 1 -- 172.21.15.106:0/2141713102 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d800d1cf0 con 0x7f0d800b5950 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7f7fe700 1 --2- 172.21.15.106:0/2141713102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800b5950 0x7f0d800b5d60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009d90 tx=0x7f0d7800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=742a73834d636dea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.239+0000 7f0d7dffb700 1 -- 172.21.15.106:0/2141713102 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7800e070 con 0x7f0d800b5950 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d7dffb700 1 -- 172.21.15.106:0/2141713102 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7800bb90 con 0x7f0d800b5950 2023-11-24T06:14:08.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d7dffb700 1 -- 172.21.15.106:0/2141713102 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d78003a20 con 0x7f0d800b5950 2023-11-24T06:14:08.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 -- 172.21.15.106:0/2141713102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800b5950 msgr2=0x7f0d800b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 --2- 172.21.15.106:0/2141713102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800b5950 0x7f0d800b5d60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009d90 tx=0x7f0d7800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:08.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 -- 172.21.15.106:0/2141713102 shutdown_connections 2023-11-24T06:14:08.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 --2- 172.21.15.106:0/2141713102 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800b5950 0x7f0d800b5d60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 -- 172.21.15.106:0/2141713102 >> 172.21.15.106:0/2141713102 conn(0x7f0d800d0950 msgr2=0x7f0d800d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 -- 172.21.15.106:0/2141713102 shutdown_connections 2023-11-24T06:14:08.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.240+0000 7f0d85427700 1 -- 172.21.15.106:0/2141713102 wait complete. 2023-11-24T06:14:08.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.241+0000 7f0d85427700 1 Processor -- start 2023-11-24T06:14:08.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.241+0000 7f0d85427700 1 -- start start 2023-11-24T06:14:08.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d800b5950 0x7f0d801f7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d8015e1d0 0x7f0d800cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801f88f0 con 0x7f0d800cf240 2023-11-24T06:14:08.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8015abd0 con 0x7f0d8015e1d0 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d85427700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d801f8050 con 0x7f0d800b5950 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d7e7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d7e7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58686/0 (socket says 172.21.15.106:58686) 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d7e7fc700 1 -- 172.21.15.106:0/1997118653 learned_addr learned my addr 172.21.15.106:0/1997118653 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d7f7fe700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d8015e1d0 0x7f0d800cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.242+0000 7f0d7effd700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d800b5950 0x7f0d801f7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 -- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d800b5950 msgr2=0x7f0d801f7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d800b5950 0x7f0d801f7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 -- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d8015e1d0 msgr2=0x7f0d800cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d8015e1d0 0x7f0d800cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 -- 172.21.15.106:0/1997118653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d78009a70 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d7e7fc700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c4a0 tx=0x7f0d7000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011790 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700118f0 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011ca0 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d801f8330 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.243+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d800c9060 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.244+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d800c9220 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.244+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0d7001c460 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.245+0000 7f0d677fe700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 0x7f0d6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.245+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d70089230 con 0x7f0d800cf240 2023-11-24T06:14:08.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.245+0000 7f0d7effd700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 0x7f0d6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.245+0000 7f0d7effd700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 0x7f0d6c06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d801e9c00 tx=0x7f0d74007f10 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.249+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0d700542e0 con 0x7f0d800cf240 2023-11-24T06:14:08.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.437+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d800c8ec0 con 0x7f0d800cf240 2023-11-24T06:14:08.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.437+0000 7f0d677fe700 1 -- 172.21.15.106:0/1997118653 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d800c8ec0 con 0x7f0d800cf240 2023-11-24T06:14:08.441 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:08.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 msgr2=0x7f0d6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 0x7f0d6c06d390 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d801e9c00 tx=0x7f0d74007f10 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 msgr2=0x7f0d8015a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c4a0 tx=0x7f0d7000c7b0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 shutdown_connections 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0d6c06aed0 0x7f0d6c06d390 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0d8015e1d0 0x7f0d800cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0d800b5950 0x7f0d801f7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 --2- 172.21.15.106:0/1997118653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d800cf240 0x7f0d8015a0e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.439+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 >> 172.21.15.106:0/1997118653 conn(0x7f0d800d0950 msgr2=0x7f0d800ce9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.440+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 shutdown_connections 2023-11-24T06:14:08.444 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.440+0000 7f0d85427700 1 -- 172.21.15.106:0/1997118653 wait complete. 2023-11-24T06:14:08.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:08.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.574+0000 7f03f57d9700 1 Processor -- start 2023-11-24T06:14:08.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.574+0000 7f03f57d9700 1 -- start start 2023-11-24T06:14:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03f57d9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03f006f440 0x7f03f00d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03f57d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0073f90 0x7f03f0074440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03f57d9700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f00cd830 con 0x7f03f015c000 2023-11-24T06:14:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03f57d9700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f0074980 con 0x7f03f006f440 2023-11-24T06:14:08.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03f57d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f006dc70 con 0x7f03f0073f90 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03f006f440 0x7f03f00d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03eeffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f03f015c000 0x7f03f006e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38954/0 (socket says 172.21.15.106:38954) 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03f006f440 0x7f03f00d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58692/0 (socket says 172.21.15.106:58692) 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03eeffd700 1 -- 172.21.15.106:0/2718953039 learned_addr learned my addr 172.21.15.106:0/2718953039 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 -- 172.21.15.106:0/2718953039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0073f90 msgr2=0x7f03f0074440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ef7fe700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0073f90 0x7f03f0074440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0073f90 0x7f03f0074440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03edffb700 1 -- 172.21.15.106:0/2718953039 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1063482905 0 0) 0x7f03f00cd830 con 0x7f03f015c000 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 -- 172.21.15.106:0/2718953039 >> v1:172.21.15.106:6789/0 conn(0x7f03f015c000 legacy=0x7f03f006e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 -- 172.21.15.106:0/2718953039 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f006eb40 con 0x7f03f006f440 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.575+0000 7f03ee7fc700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f006f440 0x7f03f00d06a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009840 tx=0x7f03e4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6334e14cbd70fa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.581 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03edffb700 1 -- 172.21.15.106:0/2718953039 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011830 con 0x7f03f006f440 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03edffb700 1 -- 172.21.15.106:0/2718953039 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e4011990 con 0x7f03f006f440 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03edffb700 1 -- 172.21.15.106:0/2718953039 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4011d20 con 0x7f03f006f440 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 -- 172.21.15.106:0/2718953039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f006f440 msgr2=0x7f03f00d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f006f440 0x7f03f00d06a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f03e4009840 tx=0x7f03e4009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 -- 172.21.15.106:0/2718953039 shutdown_connections 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f0073f90 0x7f03f0074440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 --2- 172.21.15.106:0/2718953039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f006f440 0x7f03f00d06a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 -- 172.21.15.106:0/2718953039 >> 172.21.15.106:0/2718953039 conn(0x7f03f0072960 msgr2=0x7f03f006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 -- 172.21.15.106:0/2718953039 shutdown_connections 2023-11-24T06:14:08.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.576+0000 7f03f57d9700 1 -- 172.21.15.106:0/2718953039 wait complete. 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.577+0000 7f03f57d9700 1 Processor -- start 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 -- start start 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f006f440 0x7f03f00ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f015c000 0x7f03f00af340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00b3fb0 con 0x7f03f0073f90 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ae170 con 0x7f03f015c000 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03f57d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00ae450 con 0x7f03f006f440 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03ee7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03ee7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58700/0 (socket says 172.21.15.106:58700) 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.578+0000 7f03ee7fc700 1 -- 172.21.15.106:0/1717866195 learned_addr learned my addr 172.21.15.106:0/1717866195 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ef7fe700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f015c000 0x7f03f00af340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03eeffd700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f006f440 0x7f03f00ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 -- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f006f440 msgr2=0x7f03f00ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f006f440 0x7f03f00ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 -- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f015c000 msgr2=0x7f03f00af340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.586 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f015c000 0x7f03f00af340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 -- 172.21.15.106:0/1717866195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e40094a0 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03ee7fc700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e40045f0 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e401f070 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03f00ae730 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e4003ae0 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.579+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00addb0 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.580+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f00adf40 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.580+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03e4003c40 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.581+0000 7f03d77fe700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 0x7f03dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.581+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03e4021070 con 0x7f03f0073f90 2023-11-24T06:14:08.587 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.581+0000 7f03eeffd700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 0x7f03dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.581+0000 7f03eeffd700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 0x7f03dc06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03e80012e0 tx=0x7f03e80018c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.585+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03e4056150 con 0x7f03f0073f90 2023-11-24T06:14:08.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.774+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f03f00b40f0 con 0x7f03f0073f90 2023-11-24T06:14:08.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.774+0000 7f03d77fe700 1 -- 172.21.15.106:0/1717866195 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f03f00b40f0 con 0x7f03f0073f90 2023-11-24T06:14:08.778 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:08.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 msgr2=0x7f03dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 0x7f03dc06d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f03e80012e0 tx=0x7f03e80018c0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 msgr2=0x7f03f00aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f03e4000c00 tx=0x7f03e4004750 comp rx=0 tx=0).stop 2023-11-24T06:14:08.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 shutdown_connections 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f03dc06aed0 0x7f03dc06d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03f015c000 0x7f03f00af340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03f006f440 0x7f03f00ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 --2- 172.21.15.106:0/1717866195 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03f0073f90 0x7f03f00aee00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 >> 172.21.15.106:0/1717866195 conn(0x7f03f0072960 msgr2=0x7f03f00b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 shutdown_connections 2023-11-24T06:14:08.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.776+0000 7f03f57d9700 1 -- 172.21.15.106:0/1717866195 wait complete. 2023-11-24T06:14:08.792 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:08.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.910+0000 7f201f91f700 1 Processor -- start 2023-11-24T06:14:08.914 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.910+0000 7f201f91f700 1 -- start start 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201f91f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20180cccd0 0x7f20180cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201f91f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f201815c320 0x7f201815c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201f91f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f201815ccb0 con 0x7f201815bf40 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201f91f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20180cd6a0 con 0x7f20180cccd0 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201f91f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f201806fd30 con 0x7f201815c320 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20180cccd0 0x7f20180cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201d6bb700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f201815bf40 0x7f20180af790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38968/0 (socket says 172.21.15.106:38968) 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201d6bb700 1 -- 172.21.15.106:0/2777610543 learned_addr learned my addr 172.21.15.106:0/2777610543 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201debc700 1 --2- 172.21.15.106:0/2777610543 >> v2:172.21.15.176:3300/0 conn(0x7f201815c320 0x7f201815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 -- 172.21.15.106:0/2777610543 >> v2:172.21.15.176:3300/0 conn(0x7f201815c320 msgr2=0x7f201815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 --2- 172.21.15.106:0/2777610543 >> v2:172.21.15.176:3300/0 conn(0x7f201815c320 0x7f201815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 -- 172.21.15.106:0/2777610543 >> v1:172.21.15.106:6789/0 conn(0x7f201815bf40 legacy=0x7f20180af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f200ffff700 1 -- 172.21.15.106:0/2777610543 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1725648756 0 0) 0x7f201815ccb0 con 0x7f201815bf40 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 -- 172.21.15.106:0/2777610543 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201806f770 con 0x7f20180cccd0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.911+0000 7f201ceba700 1 --2- 172.21.15.106:0/2777610543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20180cccd0 0x7f20180cd160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f201806bff0 tx=0x7f2008009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ca494245f8fb5c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f200ffff700 1 -- 172.21.15.106:0/2777610543 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011830 con 0x7f20180cccd0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f200ffff700 1 -- 172.21.15.106:0/2777610543 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2008011990 con 0x7f20180cccd0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f200ffff700 1 -- 172.21.15.106:0/2777610543 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2008011d20 con 0x7f20180cccd0 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 -- 172.21.15.106:0/2777610543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20180cccd0 msgr2=0x7f20180cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 --2- 172.21.15.106:0/2777610543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20180cccd0 0x7f20180cd160 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f201806bff0 tx=0x7f2008009b20 comp rx=0 tx=0).stop 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 -- 172.21.15.106:0/2777610543 shutdown_connections 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 --2- 172.21.15.106:0/2777610543 >> v2:172.21.15.176:3300/0 conn(0x7f201815c320 0x7f201815c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 --2- 172.21.15.106:0/2777610543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20180cccd0 0x7f20180cd160 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 -- 172.21.15.106:0/2777610543 >> 172.21.15.106:0/2777610543 conn(0x7f20180b2050 msgr2=0x7f20180b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 -- 172.21.15.106:0/2777610543 shutdown_connections 2023-11-24T06:14:08.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.912+0000 7f201f91f700 1 -- 172.21.15.106:0/2777610543 wait complete. 2023-11-24T06:14:08.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.913+0000 7f201f91f700 1 Processor -- start 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.913+0000 7f201f91f700 1 -- start start 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 0x7f201813c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201815bf40 0x7f20181531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20181f22a0 con 0x7f201815c320 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2018152470 con 0x7f201815bf40 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201f91f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f201813ced0 con 0x7f20180cccd0 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201debc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201debc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58716/0 (socket says 172.21.15.106:58716) 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201debc700 1 -- 172.21.15.106:0/1642020867 learned_addr learned my addr 172.21.15.106:0/1642020867 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201ceba700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201815bf40 0x7f20181531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.914+0000 7f201d6bb700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 0x7f201813c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 -- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 msgr2=0x7f201813c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 0x7f201813c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 -- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201815bf40 msgr2=0x7f20181531d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201815bf40 0x7f20181531d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 -- 172.21.15.106:0/1642020867 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20080094a0 con 0x7f201815c320 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201d6bb700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 0x7f201813c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201debc700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2010007e90 tx=0x7f201000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201000ede0 con 0x7f201815c320 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2010014420 con 0x7f201815c320 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20100147d0 con 0x7f201815c320 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20181f1fc0 con 0x7f201815c320 2023-11-24T06:14:08.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.915+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20181529d0 con 0x7f201815c320 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.916+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2018153020 con 0x7f201815c320 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.916+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2010014930 con 0x7f201815c320 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.917+0000 7f200dffb700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 0x7f1ffc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.917+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2010089cb0 con 0x7f201815c320 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.917+0000 7f201d6bb700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 0x7f1ffc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:08.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.917+0000 7f201d6bb700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 0x7f1ffc06d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2014000f60 tx=0x7f2014007cc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:08.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:08.921+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2010054d60 con 0x7f201815c320 2023-11-24T06:14:09.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.112+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2018068d90 con 0x7f201815c320 2023-11-24T06:14:09.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.113+0000 7f200dffb700 1 -- 172.21.15.106:0/1642020867 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2010058380 con 0x7f201815c320 2023-11-24T06:14:09.117 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 msgr2=0x7f1ffc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 0x7f1ffc06d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2014000f60 tx=0x7f2014007cc0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 msgr2=0x7f2018071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2010007e90 tx=0x7f201000e3c0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 shutdown_connections 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1ffc06aed0 0x7f1ffc06d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f201815c320 0x7f2018071800 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20180cccd0 0x7f201813c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 --2- 172.21.15.106:0/1642020867 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f201815bf40 0x7f20181531d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.119 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 >> 172.21.15.106:0/1642020867 conn(0x7f20180b2050 msgr2=0x7f20180b4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 shutdown_connections 2023-11-24T06:14:09.120 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.115+0000 7f201f91f700 1 -- 172.21.15.106:0/1642020867 wait complete. 2023-11-24T06:14:09.131 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:09.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 Processor -- start 2023-11-24T06:14:09.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 -- start start 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f050015ddd0 0x7f05000b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015e1b0 0x7f05000cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05000d1b30 0x7f05000d1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000d2500 con 0x7f05000d1b30 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05000b1d40 con 0x7f050015ddd0 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f0504a01700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b28c0 con 0x7f050015e1b0 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05000d1b30 0x7f05000d1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05000d1b30 0x7f05000d1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58724/0 (socket says 172.21.15.106:58724) 2023-11-24T06:14:09.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 -- 172.21.15.106:0/3696822969 learned_addr learned my addr 172.21.15.106:0/3696822969 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fe59c700 1 --2- 172.21.15.106:0/3696822969 >> v2:172.21.15.176:3300/0 conn(0x7f050015ddd0 0x7f05000b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fdd9b700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015e1b0 0x7f05000cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 -- 172.21.15.106:0/3696822969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015e1b0 msgr2=0x7f05000cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015e1b0 0x7f05000cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 -- 172.21.15.106:0/3696822969 >> v2:172.21.15.176:3300/0 conn(0x7f050015ddd0 msgr2=0x7f05000b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 --2- 172.21.15.106:0/3696822969 >> v2:172.21.15.176:3300/0 conn(0x7f050015ddd0 0x7f05000b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 -- 172.21.15.106:0/3696822969 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05000b1f90 con 0x7f05000d1b30 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fed9d700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f05000d1fc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f050009b4a0 tx=0x7f04f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db0771c01f77ada server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fd59a700 1 -- 172.21.15.106:0/3696822969 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800e070 con 0x7f05000d1b30 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fd59a700 1 -- 172.21.15.106:0/3696822969 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f800b9c0 con 0x7f05000d1b30 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.248+0000 7f04fd59a700 1 -- 172.21.15.106:0/3696822969 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800bd70 con 0x7f05000d1b30 2023-11-24T06:14:09.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 -- 172.21.15.106:0/3696822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 msgr2=0x7f05000d1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f05000d1fc0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f050009b4a0 tx=0x7f04f800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 -- 172.21.15.106:0/3696822969 shutdown_connections 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f05000d1fc0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 --2- 172.21.15.106:0/3696822969 >> v2:172.21.15.176:3300/0 conn(0x7f050015ddd0 0x7f05000b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 --2- 172.21.15.106:0/3696822969 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015e1b0 0x7f05000cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 -- 172.21.15.106:0/3696822969 >> 172.21.15.106:0/3696822969 conn(0x7f05000731a0 msgr2=0x7f050009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 -- 172.21.15.106:0/3696822969 shutdown_connections 2023-11-24T06:14:09.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.249+0000 7f0504a01700 1 -- 172.21.15.106:0/3696822969 wait complete. 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.250+0000 7f0504a01700 1 Processor -- start 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.250+0000 7f0504a01700 1 -- start start 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015ddd0 0x7f05000b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f050015e1b0 0x7f050015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050009f300 con 0x7f05000d1b30 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b30e0 con 0x7f050015e1b0 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f0504a01700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000b7100 con 0x7f050015ddd0 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58726/0 (socket says 172.21.15.106:58726) 2023-11-24T06:14:09.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 -- 172.21.15.106:0/1120944523 learned_addr learned my addr 172.21.15.106:0/1120944523 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fdd9b700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015ddd0 0x7f05000b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fed9d700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f050015e1b0 0x7f050015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 -- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015ddd0 msgr2=0x7f05000b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015ddd0 0x7f05000b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 -- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f050015e1b0 msgr2=0x7f050015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f050015e1b0 0x7f050015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.251+0000 7f04fe59c700 1 -- 172.21.15.106:0/1120944523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009b30 con 0x7f05000d1b30 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f04fe59c700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04f000e810 tx=0x7f04f000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0013610 con 0x7f05000d1b30 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f0013770 con 0x7f05000d1b30 2023-11-24T06:14:09.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000b2ed0 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f0013b00 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.252+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05000b7630 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.253+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500067f60 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.253+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f04f0013c60 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.254+0000 7f04eeffd700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 0x7f04e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.254+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04f00891b0 con 0x7f05000d1b30 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.254+0000 7f04fdd9b700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 0x7f04e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.254+0000 7f04fdd9b700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 0x7f04e006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f050006bde0 tx=0x7f04f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.259+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f04f00542f0 con 0x7f05000d1b30 2023-11-24T06:14:09.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.450+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f050009f4a0 con 0x7f05000d1b30 2023-11-24T06:14:09.455 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.451+0000 7f04eeffd700 1 -- 172.21.15.106:0/1120944523 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f04f0009440 con 0x7f05000d1b30 2023-11-24T06:14:09.455 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:09.455 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 msgr2=0x7f04e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 0x7f04e006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f050006bde0 tx=0x7f04f4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 msgr2=0x7f050009f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f04f000e810 tx=0x7f04f000ebd0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 shutdown_connections 2023-11-24T06:14:09.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f04e006aed0 0x7f04e006d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f050015e1b0 0x7f050015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05000d1b30 0x7f050009f6c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 --2- 172.21.15.106:0/1120944523 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f050015ddd0 0x7f05000b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 >> 172.21.15.106:0/1120944523 conn(0x7f05000731a0 msgr2=0x7f05000ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 shutdown_connections 2023-11-24T06:14:09.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.453+0000 7f0504a01700 1 -- 172.21.15.106:0/1120944523 wait complete. 2023-11-24T06:14:09.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:09.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:09.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 Processor -- start 2023-11-24T06:14:09.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 -- start start 2023-11-24T06:14:09.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe19815e160 0x7fe1980b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1980b3c60 con 0x7fe1980afc90 2023-11-24T06:14:09.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1980b4500 con 0x7fe19815e160 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19e504700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980b58c0 con 0x7fe1980746a0 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19caa1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe197fff700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe19815e160 0x7fe1980b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19caa1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:40958/0 (socket says 172.21.15.106:40958) 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe1977fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe1980afc90 0x7fe198073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:33240/0 (socket says 172.21.15.106:33240) 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19caa1700 1 -- 172.21.15.106:0/3656037998 learned_addr learned my addr 172.21.15.106:0/3656037998 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe197fff700 1 -- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 msgr2=0x7fe19806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe197fff700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe197fff700 1 -- 172.21.15.106:0/3656037998 >> v1:172.21.15.176:6789/0 conn(0x7fe1980afc90 legacy=0x7fe198073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe197fff700 1 -- 172.21.15.106:0/3656037998 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1980b0140 con 0x7fe19815e160 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe196ffd700 1 -- 172.21.15.106:0/3656037998 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4048450232 0 0) 0x7fe1980b3c60 con 0x7fe1980afc90 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.591+0000 7fe19caa1700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:09.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe197fff700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe19815e160 0x7fe1980b5da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe188009840 tx=0x7fe188009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42ded578dba7a985 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe196ffd700 1 -- 172.21.15.106:0/3656037998 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011830 con 0x7fe19815e160 2023-11-24T06:14:09.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe196ffd700 1 -- 172.21.15.106:0/3656037998 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188011990 con 0x7fe19815e160 2023-11-24T06:14:09.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe196ffd700 1 -- 172.21.15.106:0/3656037998 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188011d20 con 0x7fe19815e160 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 -- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe19815e160 msgr2=0x7fe1980b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe19815e160 0x7fe1980b5da0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe188009840 tx=0x7fe188009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 -- 172.21.15.106:0/3656037998 shutdown_connections 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1980746a0 0x7fe19806d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 --2- 172.21.15.106:0/3656037998 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe19815e160 0x7fe1980b5da0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 -- 172.21.15.106:0/3656037998 >> 172.21.15.106:0/3656037998 conn(0x7fe1980d0bf0 msgr2=0x7fe1980d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 -- 172.21.15.106:0/3656037998 shutdown_connections 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.592+0000 7fe19e504700 1 -- 172.21.15.106:0/3656037998 wait complete. 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.594+0000 7fe19e504700 1 Processor -- start 2023-11-24T06:14:09.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.594+0000 7fe19e504700 1 -- start start 2023-11-24T06:14:09.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1980746a0 0x7fe19814b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe19815e160 0x7fe1980c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1981f5450 con 0x7fe1980afc90 2023-11-24T06:14:09.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980c5d00 con 0x7fe1980746a0 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19e504700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1980c5fe0 con 0x7fe19815e160 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58742/0 (socket says 172.21.15.106:58742) 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 -- 172.21.15.106:0/2878389050 learned_addr learned my addr 172.21.15.106:0/2878389050 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe197fff700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1980746a0 0x7fe19814b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe19caa1700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe19815e160 0x7fe1980c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 -- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe19815e160 msgr2=0x7fe1980c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe19815e160 0x7fe1980c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 -- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1980746a0 msgr2=0x7fe19814b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1980746a0 0x7fe19814b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.595+0000 7fe1977fe700 1 -- 172.21.15.106:0/2878389050 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe190009b30 con 0x7fe1980afc90 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe1977fe700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0011e0 tx=0x7fe18c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c004c80 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1880094a0 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18c004e00 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18c007310 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.596+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1980c65a0 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.597+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe198074ac0 con 0x7fe1980afc90 2023-11-24T06:14:09.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.597+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe18c007470 con 0x7fe1980afc90 2023-11-24T06:14:09.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.598+0000 7fe194ff9700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 0x7fe18406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.598+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe18c089220 con 0x7fe1980afc90 2023-11-24T06:14:09.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.598+0000 7fe197fff700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 0x7fe18406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.603 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.598+0000 7fe197fff700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 0x7fe18406d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1880090b0 tx=0x7fe18801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.602+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe18c0542e0 con 0x7fe1980afc90 2023-11-24T06:14:09.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:09.699 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.801+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe198068fb0 con 0x7fe1980afc90 2023-11-24T06:14:09.803 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.801+0000 7fe194ff9700 1 -- 172.21.15.106:0/2878389050 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe18c057900 con 0x7fe1980afc90 2023-11-24T06:14:09.804 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 msgr2=0x7fe18406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 0x7fe18406d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1880090b0 tx=0x7fe18801c040 comp rx=0 tx=0).stop 2023-11-24T06:14:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 msgr2=0x7fe1981f4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe18c0011e0 tx=0x7fe18c00ca30 comp rx=0 tx=0).stop 2023-11-24T06:14:09.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 shutdown_connections 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe18406aed0 0x7fe18406d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe19815e160 0x7fe1980c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe1980746a0 0x7fe19814b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 --2- 172.21.15.106:0/2878389050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1980afc90 0x7fe1981f4f10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 >> 172.21.15.106:0/2878389050 conn(0x7fe1980d0bf0 msgr2=0x7fe1980aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 shutdown_connections 2023-11-24T06:14:09.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.803+0000 7fe19e504700 1 -- 172.21.15.106:0/2878389050 wait complete. 2023-11-24T06:14:09.818 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:09.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.938+0000 7f71ec74f700 1 Processor -- start 2023-11-24T06:14:09.941 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.938+0000 7f71ec74f700 1 -- start start 2023-11-24T06:14:09.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ec74f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f71e415e160 0x7f71e40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ec74f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71e40afc90 0x7f71e4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ec74f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71e40b3c60 con 0x7f71e40744d0 2023-11-24T06:14:09.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ec74f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e40b4500 con 0x7f71e40afc90 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ec74f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71e4074940 con 0x7f71e415e160 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71e40afc90 0x7f71e4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71e40afc90 0x7f71e4073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58748/0 (socket says 172.21.15.106:58748) 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 -- 172.21.15.106:0/2525475045 learned_addr learned my addr 172.21.15.106:0/2525475045 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71ea4eb700 1 --2- 172.21.15.106:0/2525475045 >> v2:172.21.15.176:3300/0 conn(0x7f71e415e160 0x7f71e40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.944 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 -- 172.21.15.106:0/2525475045 >> v2:172.21.15.176:3300/0 conn(0x7f71e415e160 msgr2=0x7f71e40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 --2- 172.21.15.106:0/2525475045 >> v2:172.21.15.176:3300/0 conn(0x7f71e415e160 0x7f71e40b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 -- 172.21.15.106:0/2525475045 >> v1:172.21.15.176:6789/0 conn(0x7f71e40744d0 legacy=0x7f71e406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.939+0000 7f71e9cea700 1 -- 172.21.15.106:0/2525475045 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e40b58c0 con 0x7f71e40afc90 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71e9cea700 1 --2- 172.21.15.106:0/2525475045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e4073f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71e409efa0 tx=0x7f71e0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9005b8bb0f317654 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71e94e9700 1 -- 172.21.15.106:0/2525475045 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011830 con 0x7f71e40afc90 2023-11-24T06:14:09.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71e94e9700 1 -- 172.21.15.106:0/2525475045 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0011990 con 0x7f71e40afc90 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71e94e9700 1 -- 172.21.15.106:0/2525475045 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e0011d20 con 0x7f71e40afc90 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 -- 172.21.15.106:0/2525475045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 msgr2=0x7f71e4073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 --2- 172.21.15.106:0/2525475045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e4073f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f71e409efa0 tx=0x7f71e0009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 -- 172.21.15.106:0/2525475045 shutdown_connections 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 --2- 172.21.15.106:0/2525475045 >> v2:172.21.15.176:3300/0 conn(0x7f71e415e160 0x7f71e40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 --2- 172.21.15.106:0/2525475045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e4073f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 -- 172.21.15.106:0/2525475045 >> 172.21.15.106:0/2525475045 conn(0x7f71e40d0bf0 msgr2=0x7f71e40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:09.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 -- 172.21.15.106:0/2525475045 shutdown_connections 2023-11-24T06:14:09.947 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.940+0000 7f71ec74f700 1 -- 172.21.15.106:0/2525475045 wait complete. 2023-11-24T06:14:09.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.941+0000 7f71ec74f700 1 Processor -- start 2023-11-24T06:14:09.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 -- start start 2023-11-24T06:14:09.949 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 0x7f71e4149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e160 0x7f71e40c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40ca3e0 con 0x7f71e40afc90 2023-11-24T06:14:09.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71e414a650 con 0x7f71e40744d0 2023-11-24T06:14:09.950 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ec74f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e40c6690 con 0x7f71e415e160 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71e9cea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71e9cea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58756/0 (socket says 172.21.15.106:58756) 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71e9cea700 1 -- 172.21.15.106:0/3208912946 learned_addr learned my addr 172.21.15.106:0/3208912946 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.942+0000 7f71ea4eb700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 0x7f71e4149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71eacec700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e160 0x7f71e40c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 -- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e160 msgr2=0x7f71e40c9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e160 0x7f71e40c9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 -- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 msgr2=0x7f71e4149db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 0x7f71e4149db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 -- 172.21.15.106:0/3208912946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0009550 con 0x7f71e40afc90 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71ea4eb700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 0x7f71e4149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:09.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71e9cea700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00045b0 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e001f070 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71e40c6970 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00038a0 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.943+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71e414ab80 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.944+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71e414ad10 con 0x7f71e40afc90 2023-11-24T06:14:09.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.944+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71e0021030 con 0x7f71e40afc90 2023-11-24T06:14:09.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.945+0000 7f71daffd700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 0x7f71c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:09.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.945+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e008aa00 con 0x7f71e40afc90 2023-11-24T06:14:09.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.945+0000 7f71ea4eb700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 0x7f71c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:09.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.945+0000 7f71ea4eb700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 0x7f71c806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009c30 tx=0x7f71d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:09.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:09.949+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71e0055b40 con 0x7f71e40afc90 2023-11-24T06:14:10.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.140+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71e40c6b60 con 0x7f71e40afc90 2023-11-24T06:14:10.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.141+0000 7f71daffd700 1 -- 172.21.15.106:0/3208912946 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71e0059160 con 0x7f71e40afc90 2023-11-24T06:14:10.144 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:10.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 msgr2=0x7f71c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 0x7f71c806d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f71d4009c30 tx=0x7f71d4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:10.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 msgr2=0x7f71e40c5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009870 tx=0x7f71e0004750 comp rx=0 tx=0).stop 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 shutdown_connections 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71c806aed0 0x7f71c806d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71e415e160 0x7f71e40c9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71e40744d0 0x7f71e4149db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 --2- 172.21.15.106:0/3208912946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71e40afc90 0x7f71e40c5bd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 >> 172.21.15.106:0/3208912946 conn(0x7f71e40d0bf0 msgr2=0x7f71e406eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 shutdown_connections 2023-11-24T06:14:10.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.143+0000 7f71ec74f700 1 -- 172.21.15.106:0/3208912946 wait complete. 2023-11-24T06:14:10.157 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:10.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.277+0000 7f570c9cd700 1 Processor -- start 2023-11-24T06:14:10.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.277+0000 7f570c9cd700 1 -- start start 2023-11-24T06:14:10.282 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f570c9cd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f57080cf110 0x7f57080cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f570c9cd700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080d0140 con 0x7f57080c6c30 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f570c9cd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57080d03e0 con 0x7f570815bf50 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f570c9cd700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f570815c330 con 0x7f57080cf110 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f5706d9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f57080cf110 0x7f57080cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f5705d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f57080c6c30 0x7f57080cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39026/0 (socket says 172.21.15.106:39026) 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.278+0000 7f5705d9b700 1 -- 172.21.15.106:0/2848689740 learned_addr learned my addr 172.21.15.106:0/2848689740 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f570559a700 1 -- 172.21.15.106:0/2848689740 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413080470 0 0) 0x7f57080d0140 con 0x7f57080c6c30 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f570559a700 1 -- 172.21.15.106:0/2848689740 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56f40035b0 con 0x7f57080c6c30 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f5706d9d700 1 -- 172.21.15.106:0/2848689740 >> v1:172.21.15.176:6789/0 conn(0x7f570815bf50 legacy=0x7f57080ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f5706d9d700 1 -- 172.21.15.106:0/2848689740 >> v1:172.21.15.106:6789/0 conn(0x7f57080c6c30 legacy=0x7f57080cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f5706d9d700 1 -- 172.21.15.106:0/2848689740 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57080d06c0 con 0x7f57080cf110 2023-11-24T06:14:10.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f5706d9d700 1 --2- 172.21.15.106:0/2848689740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f57080cd6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5700009d90 tx=0x7f570000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d343b90cba9a08 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f570559a700 1 -- 172.21.15.106:0/2848689740 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000e070 con 0x7f57080cf110 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f570559a700 1 -- 172.21.15.106:0/2848689740 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570000bae0 con 0x7f57080cf110 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.279+0000 7f570559a700 1 -- 172.21.15.106:0/2848689740 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000be50 con 0x7f57080cf110 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 -- 172.21.15.106:0/2848689740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 msgr2=0x7f57080cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2848689740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f57080cd6d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5700009d90 tx=0x7f570000b330 comp rx=0 tx=0).stop 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 -- 172.21.15.106:0/2848689740 shutdown_connections 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2848689740 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f57080cd6d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 -- 172.21.15.106:0/2848689740 >> 172.21.15.106:0/2848689740 conn(0x7f57080b3780 msgr2=0x7f57080b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 -- 172.21.15.106:0/2848689740 shutdown_connections 2023-11-24T06:14:10.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.280+0000 7f570c9cd700 1 -- 172.21.15.106:0/2848689740 wait complete. 2023-11-24T06:14:10.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.281+0000 7f570c9cd700 1 Processor -- start 2023-11-24T06:14:10.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.281+0000 7f570c9cd700 1 -- start start 2023-11-24T06:14:10.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57080c6c30 0x7f57081471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f570815bf50 0x7f570814f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5708147700 con 0x7f57080cf110 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57081478c0 con 0x7f570815bf50 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f570c9cd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5708150350 con 0x7f57080c6c30 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f5705d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f5705d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58770/0 (socket says 172.21.15.106:58770) 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.282+0000 7f5705d9b700 1 -- 172.21.15.106:0/2728017665 learned_addr learned my addr 172.21.15.106:0/2728017665 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 -- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57080c6c30 msgr2=0x7f57081471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57080c6c30 0x7f57081471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 -- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f570815bf50 msgr2=0x7f570814f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f570815bf50 0x7f570814f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 -- 172.21.15.106:0/2728017665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5700009a70 con 0x7f57080cf110 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f5705d9b700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c4d0 tx=0x7f56f800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8005d70 con 0x7f57080cf110 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f80070d0 con 0x7f57080cf110 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5708150630 con 0x7f57080cf110 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f8007440 con 0x7f57080cf110 2023-11-24T06:14:10.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.283+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5708147df0 con 0x7f57080cf110 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.284+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5708147f80 con 0x7f57080cf110 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.284+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56f80075a0 con 0x7f57080cf110 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.285+0000 7f56feffd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 0x7f56e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.285+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56f8088970 con 0x7f57080cf110 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.285+0000 7f570659c700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 0x7f56e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.285+0000 7f570659c700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 0x7f56e806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57080c7c30 tx=0x7f56f0006c50 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.289+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56f8053b60 con 0x7f57080cf110 2023-11-24T06:14:10.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.478+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5708068fb0 con 0x7f57080cf110 2023-11-24T06:14:10.481 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.478+0000 7f56feffd700 1 -- 172.21.15.106:0/2728017665 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56f8017020 con 0x7f57080cf110 2023-11-24T06:14:10.481 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 msgr2=0x7f56e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 0x7f56e806d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f57080c7c30 tx=0x7f56f0006c50 comp rx=0 tx=0).stop 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 msgr2=0x7f570814f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f56f800c4d0 tx=0x7f56f800c890 comp rx=0 tx=0).stop 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 shutdown_connections 2023-11-24T06:14:10.483 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f56e806aed0 0x7f56e806d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f570815bf50 0x7f570814f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f57080c6c30 0x7f57081471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 --2- 172.21.15.106:0/2728017665 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57080cf110 0x7f570814f3d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 >> 172.21.15.106:0/2728017665 conn(0x7f57080b3780 msgr2=0x7f5708153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 shutdown_connections 2023-11-24T06:14:10.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.480+0000 7f570c9cd700 1 -- 172.21.15.106:0/2728017665 wait complete. 2023-11-24T06:14:10.559 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T06:14:10.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:10.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.678+0000 7f12969fb700 1 Processor -- start 2023-11-24T06:14:10.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.678+0000 7f12969fb700 1 -- start start 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f12969fb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12900b2b60 0x7f12900ceb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f12969fb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f12900cf0d0 0x7f12900d1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f12969fb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129006bc00 con 0x7f129015e0f0 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f12969fb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900cf560 con 0x7f12900b2b60 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f12969fb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129015e4d0 con 0x7f12900cf0d0 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12900b2b60 0x7f12900ceb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128ffff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f129015e0f0 0x7f12900b9700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39038/0 (socket says 172.21.15.106:39038) 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128ffff700 1 -- 172.21.15.106:0/143140263 learned_addr learned my addr 172.21.15.106:0/143140263 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f12900b2b60 0x7f12900ceb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58776/0 (socket says 172.21.15.106:58776) 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f1294f98700 1 --2- 172.21.15.106:0/143140263 >> v2:172.21.15.176:3300/0 conn(0x7f12900cf0d0 0x7f12900d1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 -- 172.21.15.106:0/143140263 >> v2:172.21.15.176:3300/0 conn(0x7f12900cf0d0 msgr2=0x7f12900d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 --2- 172.21.15.106:0/143140263 >> v2:172.21.15.176:3300/0 conn(0x7f12900cf0d0 0x7f12900d1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 -- 172.21.15.106:0/143140263 >> v1:172.21.15.106:6789/0 conn(0x7f129015e0f0 legacy=0x7f12900b9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 -- 172.21.15.106:0/143140263 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129006aff0 con 0x7f12900b2b60 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128effd700 1 -- 172.21.15.106:0/143140263 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3109387273 0 0) 0x7f129006bc00 con 0x7f129015e0f0 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.679+0000 7f128f7fe700 1 --2- 172.21.15.106:0/143140263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900b2b60 0x7f12900ceb90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12900cae60 tx=0x7f1280009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9761a1b0b7f8b6fd server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f128effd700 1 -- 172.21.15.106:0/143140263 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280011830 con 0x7f12900b2b60 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f128effd700 1 -- 172.21.15.106:0/143140263 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1280011990 con 0x7f12900b2b60 2023-11-24T06:14:10.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f128effd700 1 -- 172.21.15.106:0/143140263 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280011d20 con 0x7f12900b2b60 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 -- 172.21.15.106:0/143140263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900b2b60 msgr2=0x7f12900ceb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 --2- 172.21.15.106:0/143140263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900b2b60 0x7f12900ceb90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f12900cae60 tx=0x7f1280009b20 comp rx=0 tx=0).stop 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 -- 172.21.15.106:0/143140263 shutdown_connections 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 --2- 172.21.15.106:0/143140263 >> v2:172.21.15.176:3300/0 conn(0x7f12900cf0d0 0x7f12900d1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 --2- 172.21.15.106:0/143140263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900b2b60 0x7f12900ceb90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 -- 172.21.15.106:0/143140263 >> 172.21.15.106:0/143140263 conn(0x7f12900b5ce0 msgr2=0x7f12900b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 -- 172.21.15.106:0/143140263 shutdown_connections 2023-11-24T06:14:10.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.680+0000 7f12969fb700 1 -- 172.21.15.106:0/143140263 wait complete. 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.681+0000 7f12969fb700 1 Processor -- start 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 -- start start 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12900b2b60 0x7f12900c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 0x7f12900b9820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12901f7ee0 con 0x7f12900cf0d0 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129014a510 con 0x7f129015e0f0 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f12969fb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12900d1060 con 0x7f12900b2b60 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58782/0 (socket says 172.21.15.106:58782) 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.682+0000 7f128f7fe700 1 -- 172.21.15.106:0/4219208980 learned_addr learned my addr 172.21.15.106:0/4219208980 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:10.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f1294f98700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 0x7f12900b9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128ffff700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12900b2b60 0x7f12900c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 -- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12900b2b60 msgr2=0x7f12900c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12900b2b60 0x7f12900c68e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 -- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 msgr2=0x7f12900b9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 0x7f12900b9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 -- 172.21.15.106:0/4219208980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12800094a0 con 0x7f12900cf0d0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f1294f98700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 0x7f12900b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128f7fe700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f129008c570 tx=0x7f1280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12800038a0 con 0x7f12900cf0d0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128001f070 con 0x7f12900cf0d0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12900c6e20 con 0x7f12900cf0d0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1280003c20 con 0x7f12900cf0d0 2023-11-24T06:14:10.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.683+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1290149ec0 con 0x7f12900cf0d0 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.684+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12900751e0 con 0x7f12900cf0d0 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.684+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f128001a430 con 0x7f12900cf0d0 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.685+0000 7f128cff9700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 0x7f127c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.685+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1280021070 con 0x7f12900cf0d0 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.685+0000 7f128ffff700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 0x7f127c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:10.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.685+0000 7f128ffff700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 0x7f127c06d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1284000f60 tx=0x7f1284009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:10.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.689+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f12800560c0 con 0x7f12900cf0d0 2023-11-24T06:14:10.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.878+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f129014a650 con 0x7f12900cf0d0 2023-11-24T06:14:10.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.879+0000 7f128cff9700 1 -- 172.21.15.106:0/4219208980 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f1280015090 con 0x7f12900cf0d0 2023-11-24T06:14:10.882 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:10.882 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.881+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 msgr2=0x7f127c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.881+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 0x7f127c06d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1284000f60 tx=0x7f1284009040 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.881+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 msgr2=0x7f12900b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.881+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f129008c570 tx=0x7f1280004750 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 shutdown_connections 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f127c06aed0 0x7f127c06d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f129015e0f0 0x7f12900b9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f12900b2b60 0x7f12900c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 --2- 172.21.15.106:0/4219208980 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12900cf0d0 0x7f12900b92e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 >> 172.21.15.106:0/4219208980 conn(0x7f12900b5ce0 msgr2=0x7f12900b60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 shutdown_connections 2023-11-24T06:14:10.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:10.882+0000 7f12969fb700 1 -- 172.21.15.106:0/4219208980 wait complete. 2023-11-24T06:14:10.897 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:10.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:11.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.017+0000 7f15b227d700 1 Processor -- start 2023-11-24T06:14:11.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.017+0000 7f15b227d700 1 -- start start 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b227d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f15ac0c6c30 0x7f15ac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b227d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0d0140 con 0x7f15ac0cef40 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b227d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15ac0cf3d0 con 0x7f15ac15bf50 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b227d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15ac15c330 con 0x7f15ac0c6c30 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b081a700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f15ac0cef40 0x7f15ac0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39052/0 (socket says 172.21.15.106:39052) 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.018+0000 7f15b081a700 1 -- 172.21.15.106:0/2276840371 learned_addr learned my addr 172.21.15.106:0/2276840371 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:11.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/2276840371 >> v2:172.21.15.176:3300/0 conn(0x7f15ac0c6c30 0x7f15ac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828395994 0 0) 0x7f15ac0d0140 con 0x7f15ac0cef40 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15940035b0 con 0x7f15ac0cef40 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532096322 0 0) 0x7f15940035b0 con 0x7f15ac0cef40 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 >> v2:172.21.15.176:3300/0 conn(0x7f15ac0c6c30 msgr2=0x7f15ac0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 --2- 172.21.15.106:0/2276840371 >> v2:172.21.15.176:3300/0 conn(0x7f15ac0c6c30 0x7f15ac0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 >> v1:172.21.15.176:6789/0 conn(0x7f15ac15bf50 legacy=0x7f15ac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac0d03e0 con 0x7f15ac0cef40 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f15a40019f0 con 0x7f15ac0cef40 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 >> v1:172.21.15.106:6789/0 conn(0x7f15ac0cef40 legacy=0x7f15ac0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1594003a00 0x7f1594003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 0x7f1594004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594005210 0x7f159400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15c330 con 0x7f1594004850 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159400c0b0 con 0x7f1594005210 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159400c270 con 0x7f1594003a00 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 0x7f1594004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15b081a700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594005210 0x7f159400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15abfff700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1594003a00 0x7f1594003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 -- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1594003a00 msgr2=0x7f1594003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1594003a00 0x7f1594003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 -- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594005210 msgr2=0x7f159400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594005210 0x7f159400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15b081a700 1 -- 172.21.15.106:0/2276840371 reap_dead start 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 -- 172.21.15.106:0/2276840371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15940035b0 con 0x7f1594004850 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15abfff700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1594003a00 0x7f1594003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.019+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 0x7f1594004cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009b60 tx=0x7f1594005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184b16e9f26eb836 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000e6c0 con 0x7f1594004850 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a000e820 con 0x7f1594004850 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15aaffd700 1 -- 172.21.15.106:0/2276840371 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a000eb90 con 0x7f1594004850 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 -- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 msgr2=0x7f1594004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 0x7f1594004cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f15a0009b60 tx=0x7f1594005880 comp rx=0 tx=0).stop 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 -- 172.21.15.106:0/2276840371 shutdown_connections 2023-11-24T06:14:11.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 --2- 172.21.15.106:0/2276840371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1594004850 0x7f1594004cd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 -- 172.21.15.106:0/2276840371 >> 172.21.15.106:0/2276840371 conn(0x7f15ac0b3780 msgr2=0x7f15ac0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 -- 172.21.15.106:0/2276840371 shutdown_connections 2023-11-24T06:14:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.020+0000 7f15b227d700 1 -- 172.21.15.106:0/2276840371 wait complete. 2023-11-24T06:14:11.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.022+0000 7f15b227d700 1 Processor -- start 2023-11-24T06:14:11.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.022+0000 7f15b227d700 1 -- start start 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 0x7f15ac150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15ac15de90 0x7f15ac0cac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15e870 con 0x7f15ac15e310 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15eb50 con 0x7f1594004850 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15ac15ee30 con 0x7f15ac15de90 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58804/0 (socket says 172.21.15.106:58804) 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 -- 172.21.15.106:0/3971337270 learned_addr learned my addr 172.21.15.106:0/3971337270 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:11.031 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15abfff700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 0x7f15ac150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15ab7fe700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15ac15de90 0x7f15ac0cac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 -- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15ac15de90 msgr2=0x7f15ac0cac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15ac15de90 0x7f15ac0cac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 -- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 msgr2=0x7f15ac150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 0x7f15ac150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 -- 172.21.15.106:0/3971337270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac15f110 con 0x7f15ac15e310 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15abfff700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 0x7f15ac150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b081a700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15ac071c50 tx=0x7f15a400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a400ac80 con 0x7f15ac15e310 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a400ade0 con 0x7f15ac15e310 2023-11-24T06:14:11.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15ac15f3f0 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.023+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a4013630 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.024+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15ac0cce90 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.024+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15ac09d3f0 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.025+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15a4013790 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.025+0000 7f15a8ff9700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 0x7f159806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.025+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15a408a1a0 con 0x7f15ac15e310 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.025+0000 7f15abfff700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 0x7f159806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.033 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.026+0000 7f15abfff700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 0x7f159806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.030+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15a40551b0 con 0x7f15ac15e310 2023-11-24T06:14:11.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.219+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15ac0cd080 con 0x7f15ac15e310 2023-11-24T06:14:11.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.219+0000 7f15a8ff9700 1 -- 172.21.15.106:0/3971337270 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15ac0cd080 con 0x7f15ac15e310 2023-11-24T06:14:11.222 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:11.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 msgr2=0x7f159806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 0x7f159806d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f159c000c00 tx=0x7f159c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 msgr2=0x7f15ac0cb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f15ac071c50 tx=0x7f15a400a5f0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 shutdown_connections 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f159806af00 0x7f159806d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15ac15e310 0x7f15ac0cb1d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1594004850 0x7f15ac150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.221+0000 7f15b227d700 1 --2- 172.21.15.106:0/3971337270 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f15ac15de90 0x7f15ac0cac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.222+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 >> 172.21.15.106:0/3971337270 conn(0x7f15ac0b3780 msgr2=0x7f15ac0c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.222+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 shutdown_connections 2023-11-24T06:14:11.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.222+0000 7f15b227d700 1 -- 172.21.15.106:0/3971337270 wait complete. 2023-11-24T06:14:11.236 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:11.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.356+0000 7fe8f241f700 1 Processor -- start 2023-11-24T06:14:11.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.356+0000 7fe8f241f700 1 -- start start 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 0x7fe8ec0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe8ec0afc90 0x7fe8ec073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8ec0744d0 0x7fe8ec06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b4500 con 0x7fe8ec0744d0 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8ec074960 con 0x7fe8ec0afc90 2023-11-24T06:14:11.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f241f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec0b3c60 con 0x7fe8ec15e160 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8ec0744d0 0x7fe8ec06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8ec0744d0 0x7fe8ec06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58812/0 (socket says 172.21.15.106:58812) 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 -- 172.21.15.106:0/2120160770 learned_addr learned my addr 172.21.15.106:0/2120160770 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8eb7fe700 1 --2- 172.21.15.106:0/2120160770 >> v2:172.21.15.176:3300/0 conn(0x7fe8ec0afc90 0x7fe8ec073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8ebfff700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 0x7fe8ec0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 -- 172.21.15.106:0/2120160770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 msgr2=0x7fe8ec0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 0x7fe8ec0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 -- 172.21.15.106:0/2120160770 >> v2:172.21.15.176:3300/0 conn(0x7fe8ec0afc90 msgr2=0x7fe8ec073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 --2- 172.21.15.106:0/2120160770 >> v2:172.21.15.176:3300/0 conn(0x7fe8ec0afc90 0x7fe8ec073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8f09bc700 1 -- 172.21.15.106:0/2120160770 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8ec0b58c0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.357+0000 7fe8ebfff700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 0x7fe8ec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:11.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f09bc700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec06d930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec09f020 tx=0x7fe8e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbacd2f84fed4518 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8eaffd700 1 -- 172.21.15.106:0/2120160770 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400e070 con 0x7fe8ec0744d0 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8eaffd700 1 -- 172.21.15.106:0/2120160770 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e400b910 con 0x7fe8ec0744d0 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8eaffd700 1 -- 172.21.15.106:0/2120160770 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e400bcc0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 -- 172.21.15.106:0/2120160770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 msgr2=0x7fe8ec06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec06d930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec09f020 tx=0x7fe8e400b330 comp rx=0 tx=0).stop 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 -- 172.21.15.106:0/2120160770 shutdown_connections 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec06d930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2120160770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec15e160 0x7fe8ec0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2120160770 >> v2:172.21.15.176:3300/0 conn(0x7fe8ec0afc90 0x7fe8ec073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 -- 172.21.15.106:0/2120160770 >> 172.21.15.106:0/2120160770 conn(0x7fe8ec0d0bf0 msgr2=0x7fe8ec0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 -- 172.21.15.106:0/2120160770 shutdown_connections 2023-11-24T06:14:11.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.358+0000 7fe8f241f700 1 -- 172.21.15.106:0/2120160770 wait complete. 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.359+0000 7fe8f241f700 1 Processor -- start 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 -- start start 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec0afc90 0x7fe8ec0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 0x7fe8ec0b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec148ea0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec1490b0 con 0x7fe8ec15e160 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8f241f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8ec149390 con 0x7fe8ec0afc90 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8ebfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8ebfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58814/0 (socket says 172.21.15.106:58814) 2023-11-24T06:14:11.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.360+0000 7fe8ebfff700 1 -- 172.21.15.106:0/2550110646 learned_addr learned my addr 172.21.15.106:0/2550110646 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8eb7fe700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec0afc90 0x7fe8ec0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 -- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec0afc90 msgr2=0x7fe8ec0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8f09bc700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 0x7fe8ec0b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec0afc90 0x7fe8ec0b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 -- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 msgr2=0x7fe8ec0b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 0x7fe8ec0b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 -- 172.21.15.106:0/2550110646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8e4009b30 con 0x7fe8ec0744d0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8f09bc700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 0x7fe8ec0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8ebfff700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000e760 tx=0x7fe8e000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0013610 con 0x7fe8ec0744d0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8e0013770 con 0x7fe8ec0744d0 2023-11-24T06:14:11.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8ec149670 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0013b20 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.361+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8ec148b50 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.362+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8ec1491f0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.362+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe8e0013c80 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.363+0000 7fe8e8ff9700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 0x7fe8d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.363+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8e0089160 con 0x7fe8ec0744d0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.363+0000 7fe8eb7fe700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 0x7fe8d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.363+0000 7fe8eb7fe700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 0x7fe8d806d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec15f8b0 tx=0x7fe8dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.367+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe8ec1491f0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.557+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8ec1491f0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.557+0000 7fe8e8ff9700 1 -- 172.21.15.106:0/2550110646 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8ec1491f0 con 0x7fe8ec0744d0 2023-11-24T06:14:11.560 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 msgr2=0x7fe8d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 0x7fe8d806d390 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe8ec15f8b0 tx=0x7fe8dc008040 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 msgr2=0x7fe8ec148610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8e000e760 tx=0x7fe8e000eb20 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 shutdown_connections 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe8d806aed0 0x7fe8d806d390 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe8ec15e160 0x7fe8ec0b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8ec0744d0 0x7fe8ec148610 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 --2- 172.21.15.106:0/2550110646 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe8ec0afc90 0x7fe8ec0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 >> 172.21.15.106:0/2550110646 conn(0x7fe8ec0d0bf0 msgr2=0x7fe8ec15d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 shutdown_connections 2023-11-24T06:14:11.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.560+0000 7fe8f241f700 1 -- 172.21.15.106:0/2550110646 wait complete. 2023-11-24T06:14:11.575 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:11.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 Processor -- start 2023-11-24T06:14:11.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 -- start start 2023-11-24T06:14:11.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb7e80aedc0 0x7fb7e80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e806e400 con 0x7fb7e815e290 2023-11-24T06:14:11.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e806e630 con 0x7fb7e80ad870 2023-11-24T06:14:11.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.695+0000 7fb7eee43700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e806fde0 con 0x7fb7e80aedc0 2023-11-24T06:14:11.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e7fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb7e815e290 0x7fb7e80af1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39086/0 (socket says 172.21.15.106:39086) 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e7fff700 1 -- 172.21.15.106:0/3905524933 learned_addr learned my addr 172.21.15.106:0/3905524933 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108255640 0 0) 0x7fb7e806e400 con 0x7fb7e815e290 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d40035b0 con 0x7fb7e815e290 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7ecbdf700 1 --2- 172.21.15.106:0/3905524933 >> v2:172.21.15.176:3300/0 conn(0x7fb7e80aedc0 0x7fb7e80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403764720 0 0) 0x7fb7d40035b0 con 0x7fb7e815e290 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 >> v2:172.21.15.176:3300/0 conn(0x7fb7e80aedc0 msgr2=0x7fb7e80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 --2- 172.21.15.106:0/3905524933 >> v2:172.21.15.176:3300/0 conn(0x7fb7e80aedc0 0x7fb7e80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 >> v1:172.21.15.176:6789/0 conn(0x7fb7e80ad870 legacy=0x7fb7e806f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e806e910 con 0x7fb7e815e290 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb7d0001670 con 0x7fb7e815e290 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 >> v1:172.21.15.106:6789/0 conn(0x7fb7e815e290 legacy=0x7fb7e80af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7d4003a00 0x7fb7d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 0x7fb7d4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d40052e0 0x7fb7d4014220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e806fde0 con 0x7fb7d4004850 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d40149f0 con 0x7fb7d4003a00 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d4014bb0 con 0x7fb7d40052e0 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 0x7fb7d4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7ecbdf700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7d4003a00 0x7fb7d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.696+0000 7fb7ed3e0700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d40052e0 0x7fb7d4014220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 -- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d40052e0 msgr2=0x7fb7d4014220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d40052e0 0x7fb7d4014220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 -- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7d4003a00 msgr2=0x7fb7d4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:11.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7d4003a00 0x7fb7d4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7ed3e0700 1 -- 172.21.15.106:0/3905524933 reap_dead start 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 -- 172.21.15.106:0/3905524933 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40035b0 con 0x7fb7d4004850 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 0x7fb7d4004cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c2f0 tx=0x7fb7d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bb1c8ad5b423a7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000ce30 con 0x7fb7d4004850 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0005960 con 0x7fb7d4004850 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7e77fe700 1 -- 172.21.15.106:0/3905524933 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0005d10 con 0x7fb7d4004850 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 -- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 msgr2=0x7fb7d4004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 0x7fb7d4004cd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c2f0 tx=0x7fb7d4005880 comp rx=0 tx=0).stop 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 -- 172.21.15.106:0/3905524933 shutdown_connections 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 --2- 172.21.15.106:0/3905524933 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7d4004850 0x7fb7d4004cd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 -- 172.21.15.106:0/3905524933 >> 172.21.15.106:0/3905524933 conn(0x7fb7e80b2050 msgr2=0x7fb7e80b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 -- 172.21.15.106:0/3905524933 shutdown_connections 2023-11-24T06:14:11.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.697+0000 7fb7eee43700 1 -- 172.21.15.106:0/3905524933 wait complete. 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.699+0000 7fb7eee43700 1 Processor -- start 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.699+0000 7fb7eee43700 1 -- start start 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.699+0000 7fb7eee43700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d4004850 0x7fb7e81eef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.699+0000 7fb7eee43700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.699+0000 7fb7eee43700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7e8159aa0 0x7fb7e8159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7eee43700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80ce370 con 0x7fb7e81435a0 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7eee43700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e815a470 con 0x7fb7e8159aa0 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7eee43700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80cdff0 con 0x7fb7d4004850 2023-11-24T06:14:11.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58836/0 (socket says 172.21.15.106:58836) 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 -- 172.21.15.106:0/537977736 learned_addr learned my addr 172.21.15.106:0/537977736 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 -- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d4004850 msgr2=0x7fb7e81eef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d4004850 0x7fb7e81eef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 -- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7e8159aa0 msgr2=0x7fb7e8159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7e8159aa0 0x7fb7e8159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 -- 172.21.15.106:0/537977736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e815ce40 con 0x7fb7e81435a0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e7fff700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c8e0 tx=0x7fb7d0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004870 con 0x7fb7e81435a0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d00049d0 con 0x7fb7e81435a0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e815d120 con 0x7fb7e81435a0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0004d80 con 0x7fb7e81435a0 2023-11-24T06:14:11.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.700+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e815cb30 con 0x7fb7e81435a0 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.701+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8068d90 con 0x7fb7e81435a0 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.702+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb7d0007070 con 0x7fb7e81435a0 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.702+0000 7fb7e57fa700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 0x7fb7c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.702+0000 7fb7ecbdf700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 0x7fb7c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.702+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d008a720 con 0x7fb7e81435a0 2023-11-24T06:14:11.708 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.702+0000 7fb7ecbdf700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 0x7fb7c806d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00070b0 tx=0x7fb7e0007040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:11.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.706+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb7d0055920 con 0x7fb7e81435a0 2023-11-24T06:14:11.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.893+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7e80ce4b0 con 0x7fb7e81435a0 2023-11-24T06:14:11.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.894+0000 7fb7e57fa700 1 -- 172.21.15.106:0/537977736 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7e80ce4b0 con 0x7fb7e81435a0 2023-11-24T06:14:11.897 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 msgr2=0x7fb7c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 0x7fb7c806d390 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00070b0 tx=0x7fb7e0007040 comp rx=0 tx=0).stop 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 msgr2=0x7fb7e815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000c8e0 tx=0x7fb7d0001a00 comp rx=0 tx=0).stop 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 shutdown_connections 2023-11-24T06:14:11.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb7c806aed0 0x7fb7c806d390 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb7e8159aa0 0x7fb7e8159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb7d4004850 0x7fb7e81eef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 --2- 172.21.15.106:0/537977736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7e81435a0 0x7fb7e815c5f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 >> 172.21.15.106:0/537977736 conn(0x7fb7e80b2050 msgr2=0x7fb7e80af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 shutdown_connections 2023-11-24T06:14:11.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:11.896+0000 7fb7eee43700 1 -- 172.21.15.106:0/537977736 wait complete. 2023-11-24T06:14:11.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T06:14:12.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 Processor -- start 2023-11-24T06:14:12.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 -- start start 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc15bdd0 0x7f5ebc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5ebc0b3370 0x7f5ebc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ebc0b2030 con 0x7f5ebc0d1c70 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b2f50 con 0x7f5ebc0b3370 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.030+0000 7f5ec2700700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0b22d0 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ec0c9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5ebc0d1c70 0x7f5ebc0ce6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39104/0 (socket says 172.21.15.106:39104) 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ec0c9d700 1 -- 172.21.15.106:0/1982359791 learned_addr learned my addr 172.21.15.106:0/1982359791 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 --2- 172.21.15.106:0/1982359791 >> v2:172.21.15.176:3300/0 conn(0x7f5ebc0b3370 0x7f5ebc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebbfff700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc15bdd0 0x7f5ebc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1730462365 0 0) 0x7f5ebc0b2030 con 0x7f5ebc0d1c70 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea40035b0 con 0x7f5ebc0d1c70 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3423531878 0 0) 0x7f5ea40035b0 con 0x7f5ebc0d1c70 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 -- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc15bdd0 msgr2=0x7f5ebc1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc15bdd0 0x7f5ebc1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 -- 172.21.15.106:0/1982359791 >> v1:172.21.15.106:6789/0 conn(0x7f5ebc0d1c70 legacy=0x7f5ebc0ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 -- 172.21.15.106:0/1982359791 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ebc0b25b0 con 0x7f5ebc0b3370 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebb7fe700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0b3370 0x7f5ebc0b1af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009840 tx=0x7f5eb0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7dd5343479813be server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb40019f0 con 0x7f5ebc0b3370 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb0004030 con 0x7f5ebc0b3370 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.031+0000 7f5ebaffd700 1 -- 172.21.15.106:0/1982359791 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00043c0 con 0x7f5ebc0b3370 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 -- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0b3370 msgr2=0x7f5ebc0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0b3370 0x7f5ebc0b1af0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009840 tx=0x7f5eb0009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 -- 172.21.15.106:0/1982359791 shutdown_connections 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc15bdd0 0x7f5ebc1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 --2- 172.21.15.106:0/1982359791 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0b3370 0x7f5ebc0b1af0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 -- 172.21.15.106:0/1982359791 >> 172.21.15.106:0/1982359791 conn(0x7f5ebc0731a0 msgr2=0x7f5ebc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 -- 172.21.15.106:0/1982359791 shutdown_connections 2023-11-24T06:14:12.037 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.032+0000 7f5ec2700700 1 -- 172.21.15.106:0/1982359791 wait complete. 2023-11-24T06:14:12.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.033+0000 7f5ec2700700 1 Processor -- start 2023-11-24T06:14:12.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.033+0000 7f5ec2700700 1 -- start start 2023-11-24T06:14:12.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc0b3370 0x7f5ebc14c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 0x7f5ebc06c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc157900 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c5ad0 con 0x7f5ebc0d1c70 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec2700700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ebc0c5db0 con 0x7f5ebc0b3370 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec0c9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec0c9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58852/0 (socket says 172.21.15.106:58852) 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.034+0000 7f5ec0c9d700 1 -- 172.21.15.106:0/2830851101 learned_addr learned my addr 172.21.15.106:0/2830851101 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ebb7fe700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 0x7f5ebc06c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ebbfff700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc0b3370 0x7f5ebc14c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 -- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc0b3370 msgr2=0x7f5ebc14c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc0b3370 0x7f5ebc14c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 -- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 msgr2=0x7f5ebc06c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:12.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 0x7f5ebc06c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 -- 172.21.15.106:0/2830851101 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb00094a0 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ebb7fe700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 0x7f5ebc06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec0c9d700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400cca0 tx=0x7f5eb400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb400cea0 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb400ae00 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb4007310 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ebc0c6090 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.035+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ebc0c6650 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.036+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ebc067f60 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.036+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5eb4007470 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.037+0000 7f5eb8ff9700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 0x7f5ea806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:12.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.037+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5eb4089280 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.037+0000 7f5ebbfff700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 0x7f5ea806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:12.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.037+0000 7f5ebbfff700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 0x7f5ea806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009a10 tx=0x7f5eac008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:12.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.041+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5eb40542b0 con 0x7f5ebc15bdd0 2023-11-24T06:14:12.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:12.313+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f5ebc0b7c60 con 0x7f5ebc15bdd0 2023-11-24T06:14:13.135 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.132+0000 7f5eb8ff9700 1 -- 172.21.15.106:0/2830851101 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v53) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5eb40578d0 con 0x7f5ebc15bdd0 2023-11-24T06:14:13.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 msgr2=0x7f5ea806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 0x7f5ea806d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5eac009a10 tx=0x7f5eac008040 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 msgr2=0x7f5ebc0cd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f5eb400cca0 tx=0x7f5eb400a340 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 shutdown_connections 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5ea806aed0 0x7f5ea806d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ebc15bdd0 0x7f5ebc0cd6d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5ebc0b3370 0x7f5ebc14c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 --2- 172.21.15.106:0/2830851101 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5ebc0d1c70 0x7f5ebc06c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.135+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 >> 172.21.15.106:0/2830851101 conn(0x7f5ebc0731a0 msgr2=0x7f5ebc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.136+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 shutdown_connections 2023-11-24T06:14:13.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.136+0000 7f5ec2700700 1 -- 172.21.15.106:0/2830851101 wait complete. 2023-11-24T06:14:13.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:14:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.278+0000 7f446cb87700 1 Processor -- start 2023-11-24T06:14:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.278+0000 7f446cb87700 1 -- start start 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446cb87700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 0x7f44680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446cb87700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680d0140 con 0x7f44680c6c30 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446cb87700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44680cf3c0 con 0x7f44680ce830 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446cb87700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446815c330 con 0x7f446815bf50 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f4466d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f44680c6c30 0x7f44680cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39122/0 (socket says 172.21.15.106:39122) 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f4466d9d700 1 -- 172.21.15.106:0/4051847581 learned_addr learned my addr 172.21.15.106:0/4051847581 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446659c700 1 --2- 172.21.15.106:0/4051847581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 0x7f44680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.279+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2388654629 0 0) 0x7f44680d0140 con 0x7f44680c6c30 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44500035b0 con 0x7f44680c6c30 2023-11-24T06:14:13.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450995075 0 0) 0x7f44680cf3c0 con 0x7f44680ce830 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44680d0140 con 0x7f44680ce830 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446659c700 1 -- 172.21.15.106:0/4051847581 >> v1:172.21.15.176:6789/0 conn(0x7f44680ce830 legacy=0x7f44680cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446659c700 1 -- 172.21.15.106:0/4051847581 >> v1:172.21.15.106:6789/0 conn(0x7f44680c6c30 legacy=0x7f44680cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446659c700 1 -- 172.21.15.106:0/4051847581 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44680d03e0 con 0x7f446815bf50 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446659c700 1 --2- 172.21.15.106:0/4051847581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 0x7f44680ce2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f445c009870 tx=0x7f445c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962a240af8a271c1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c011830 con 0x7f446815bf50 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c011990 con 0x7f446815bf50 2023-11-24T06:14:13.284 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.280+0000 7f446559a700 1 -- 172.21.15.106:0/4051847581 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c011d20 con 0x7f446815bf50 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 -- 172.21.15.106:0/4051847581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 msgr2=0x7f44680ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 --2- 172.21.15.106:0/4051847581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 0x7f44680ce2f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f445c009870 tx=0x7f445c009b80 comp rx=0 tx=0).stop 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 -- 172.21.15.106:0/4051847581 shutdown_connections 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 --2- 172.21.15.106:0/4051847581 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f446815bf50 0x7f44680ce2f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 -- 172.21.15.106:0/4051847581 >> 172.21.15.106:0/4051847581 conn(0x7f44680b3780 msgr2=0x7f44680b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 -- 172.21.15.106:0/4051847581 shutdown_connections 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.281+0000 7f446cb87700 1 -- 172.21.15.106:0/4051847581 wait complete. 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.282+0000 7f446cb87700 1 Processor -- start 2023-11-24T06:14:13.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.282+0000 7f446cb87700 1 -- start start 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44680ce830 0x7f44680cb930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446815bf50 0x7f44681594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680caf20 con 0x7f44680c6c30 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44680ca5b0 con 0x7f446815bf50 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446cb87700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44680ca890 con 0x7f44680ce830 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58862/0 (socket says 172.21.15.106:58862) 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 -- 172.21.15.106:0/3944897056 learned_addr learned my addr 172.21.15.106:0/3944897056 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 -- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44680ce830 msgr2=0x7f44680cb930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44680ce830 0x7f44680cb930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.288 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 -- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446815bf50 msgr2=0x7f44681594d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446815bf50 0x7f44681594d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 -- 172.21.15.106:0/3944897056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f445c0094a0 con 0x7f44680c6c30 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.283+0000 7f446659c700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f445c009bc0 tx=0x7f445c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.284+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c01a860 con 0x7f44680c6c30 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.284+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f445c01a9c0 con 0x7f44680c6c30 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.284+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f445c01ad70 con 0x7f44680c6c30 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.284+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44680cab70 con 0x7f44680c6c30 2023-11-24T06:14:13.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.284+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44680cb410 con 0x7f44680c6c30 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.285+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44680cb5a0 con 0x7f44680c6c30 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.285+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f445c022070 con 0x7f44680c6c30 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.285+0000 7f4456ffd700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 0x7f444806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.286+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f445c08a340 con 0x7f44680c6c30 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.286+0000 7f4465d9b700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 0x7f444806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.286+0000 7f4465d9b700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 0x7f444806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f446815abb0 tx=0x7f4458007930 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.292 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.290+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f445c055480 con 0x7f44680c6c30 2023-11-24T06:14:13.484 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.482+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4468068fb0 con 0x7f44680c6c30 2023-11-24T06:14:13.487 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.485+0000 7f4456ffd700 1 -- 172.21.15.106:0/3944897056 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f445c058aa0 con 0x7f44680c6c30 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 msgr2=0x7f444806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 0x7f444806d390 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f446815abb0 tx=0x7f4458007930 comp rx=0 tx=0).stop 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 msgr2=0x7f4468155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f445c009bc0 tx=0x7f445c004750 comp rx=0 tx=0).stop 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 shutdown_connections 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f444806aed0 0x7f444806d390 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f446815bf50 0x7f44681594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44680c6c30 0x7f4468155cf0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 --2- 172.21.15.106:0/3944897056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f44680ce830 0x7f44680cb930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 >> 172.21.15.106:0/3944897056 conn(0x7f44680b3780 msgr2=0x7f44680b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 shutdown_connections 2023-11-24T06:14:13.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.487+0000 7f446cb87700 1 -- 172.21.15.106:0/3944897056 wait complete. 2023-11-24T06:14:13.502 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:14:13.502 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:13.549 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:13.595 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:14:13.595 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:13.596 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:13.613 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:13.613 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:13.670 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:13.670 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:13.727 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.884+0000 7f99b6bc6700 1 Processor -- start 2023-11-24T06:14:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 -- start start 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99b00b1a70 0x7f99b0164b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b00cfd40 con 0x7f99b015ae20 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b00d0020 con 0x7f99b00b1a70 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b6bc6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00affa0 con 0x7f99b015b200 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b5163700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99b00b1a70 0x7f99b0164b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.890 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b5163700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f99b00b1a70 0x7f99b0164b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58874/0 (socket says 172.21.15.106:58874) 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.885+0000 7f99b5163700 1 -- 172.21.15.106:0/3050849949 learned_addr learned my addr 172.21.15.106:0/3050849949 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99affff700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99b5163700 1 -- 172.21.15.106:0/3050849949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 msgr2=0x7f99b00b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99b5163700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00b29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99b5163700 1 -- 172.21.15.106:0/3050849949 >> v1:172.21.15.176:6789/0 conn(0x7f99b015ae20 legacy=0x7f99b00b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99b5163700 1 -- 172.21.15.106:0/3050849949 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b00b0280 con 0x7f99b00b1a70 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99b5163700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b00b1a70 0x7f99b0164b50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39d65fa16b244c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99af7fe700 1 -- 172.21.15.106:0/3050849949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800e070 con 0x7f99b00b1a70 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99af7fe700 1 -- 172.21.15.106:0/3050849949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a800b9c0 con 0x7f99b00b1a70 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.886+0000 7f99af7fe700 1 -- 172.21.15.106:0/3050849949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a800bd70 con 0x7f99b00b1a70 2023-11-24T06:14:13.891 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 -- 172.21.15.106:0/3050849949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b00b1a70 msgr2=0x7f99b0164b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b00b1a70 0x7f99b0164b50 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f99a8009e50 tx=0x7f99a800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 -- 172.21.15.106:0/3050849949 shutdown_connections 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b00b1a70 0x7f99b0164b50 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/3050849949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 -- 172.21.15.106:0/3050849949 >> 172.21.15.106:0/3050849949 conn(0x7f99b00b57b0 msgr2=0x7f99b00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 -- 172.21.15.106:0/3050849949 shutdown_connections 2023-11-24T06:14:13.892 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.887+0000 7f99b6bc6700 1 -- 172.21.15.106:0/3050849949 wait complete. 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.888+0000 7f99b6bc6700 1 Processor -- start 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.888+0000 7f99b6bc6700 1 -- start start 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b00b1a70 0x7f99b00cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b00ccb90 con 0x7f99b015ae20 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01f0c70 con 0x7f99b00b1a70 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99b6bc6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b01f0f50 con 0x7f99b015b200 2023-11-24T06:14:13.895 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99affff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99affff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58878/0 (socket says 172.21.15.106:58878) 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.889+0000 7f99affff700 1 -- 172.21.15.106:0/1051162430 learned_addr learned my addr 172.21.15.106:0/1051162430 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 -- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 msgr2=0x7f99b00ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 -- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b00b1a70 msgr2=0x7f99b00cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b00b1a70 0x7f99b00cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 -- 172.21.15.106:0/1051162430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009b30 con 0x7f99b015ae20 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99affff700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f999c00fa30 tx=0x7f999c00fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c007ae0 con 0x7f99b015ae20 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c007c40 con 0x7f99b015ae20 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b01f1230 con 0x7f99b015ae20 2023-11-24T06:14:13.896 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c011450 con 0x7f99b015ae20 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.890+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b01583e0 con 0x7f99b015ae20 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.891+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b0067f60 con 0x7f99b015ae20 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.891+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f999c0115b0 con 0x7f99b015ae20 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.892+0000 7f99ad7fa700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 0x7f999406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.892+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f999c08baf0 con 0x7f99b015ae20 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.892+0000 7f99b4962700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 0x7f999406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:13.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.892+0000 7f99b4962700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 0x7f999406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000f60 tx=0x7f99a4007a40 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:13.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:13.896+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f999c056ce0 con 0x7f99b015ae20 2023-11-24T06:14:14.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.092+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99b00cde80 con 0x7f99b015ae20 2023-11-24T06:14:14.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.093+0000 7f99ad7fa700 1 -- 172.21.15.106:0/1051162430 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f999c021090 con 0x7f99b015ae20 2023-11-24T06:14:14.096 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:14.096 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 msgr2=0x7f999406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 0x7f999406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f99a4000f60 tx=0x7f99a4007a40 comp rx=0 tx=0).stop 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 msgr2=0x7f99b01f1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f999c00fa30 tx=0x7f999c00fdf0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 shutdown_connections 2023-11-24T06:14:14.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f999406aed0 0x7f999406d390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f99b015b200 0x7f99b00ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f99b00b1a70 0x7f99b00cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 --2- 172.21.15.106:0/1051162430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99b015ae20 0x7f99b01f1820 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 >> 172.21.15.106:0/1051162430 conn(0x7f99b00b57b0 msgr2=0x7f99b006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 shutdown_connections 2023-11-24T06:14:14.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.095+0000 7f99b6bc6700 1 -- 172.21.15.106:0/1051162430 wait complete. 2023-11-24T06:14:14.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:14.110 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:14.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.231+0000 7f4f1784f700 1 Processor -- start 2023-11-24T06:14:14.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.231+0000 7f4f1784f700 1 -- start start 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f1784f700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4f100b4310 0x7f4f1006bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f1784f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f100ce430 0x7f4f100ce880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f1784f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f100cedc0 con 0x7f4f1015e080 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f1784f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f100d1200 con 0x7f4f100ce430 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f1784f700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1015e460 con 0x7f4f100b4310 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f100ce430 0x7f4f100ce880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4f100ce430 0x7f4f100ce880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58888/0 (socket says 172.21.15.106:58888) 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 -- 172.21.15.106:0/1078315213 learned_addr learned my addr 172.21.15.106:0/1078315213 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f14dea700 1 --2- 172.21.15.106:0/1078315213 >> v2:172.21.15.176:3300/0 conn(0x7f4f100b4310 0x7f4f1006bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 -- 172.21.15.106:0/1078315213 >> v2:172.21.15.176:3300/0 conn(0x7f4f100b4310 msgr2=0x7f4f1006bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 --2- 172.21.15.106:0/1078315213 >> v2:172.21.15.176:3300/0 conn(0x7f4f100b4310 0x7f4f1006bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 -- 172.21.15.106:0/1078315213 >> v1:172.21.15.176:6789/0 conn(0x7f4f1015e080 legacy=0x7f4f100d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 -- 172.21.15.106:0/1078315213 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1006ba50 con 0x7f4f100ce430 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f15dec700 1 --2- 172.21.15.106:0/1078315213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f100ce880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f10072420 tx=0x7f4f0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7775d606d49735ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f07fff700 1 -- 172.21.15.106:0/1078315213 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800e070 con 0x7f4f100ce430 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f07fff700 1 -- 172.21.15.106:0/1078315213 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f0800b9c0 con 0x7f4f100ce430 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.232+0000 7f4f07fff700 1 -- 172.21.15.106:0/1078315213 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0800bd70 con 0x7f4f100ce430 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 -- 172.21.15.106:0/1078315213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 msgr2=0x7f4f100ce880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 --2- 172.21.15.106:0/1078315213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f100ce880 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4f10072420 tx=0x7f4f0800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:14.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 -- 172.21.15.106:0/1078315213 shutdown_connections 2023-11-24T06:14:14.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 --2- 172.21.15.106:0/1078315213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f100ce880 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 --2- 172.21.15.106:0/1078315213 >> v2:172.21.15.176:3300/0 conn(0x7f4f100b4310 0x7f4f1006bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 -- 172.21.15.106:0/1078315213 >> 172.21.15.106:0/1078315213 conn(0x7f4f100b3780 msgr2=0x7f4f100b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 -- 172.21.15.106:0/1078315213 shutdown_connections 2023-11-24T06:14:14.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.233+0000 7f4f1784f700 1 -- 172.21.15.106:0/1078315213 wait complete. 2023-11-24T06:14:14.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.234+0000 7f4f1784f700 1 Processor -- start 2023-11-24T06:14:14.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.234+0000 7f4f1784f700 1 -- start start 2023-11-24T06:14:14.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 0x7f4f1015b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f1015e080 0x7f4f100c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1015b5b0 con 0x7f4f100ce430 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100b5c10 con 0x7f4f1015e080 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f1784f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f100c69d0 con 0x7f4f100b4310 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58890/0 (socket says 172.21.15.106:58890) 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 -- 172.21.15.106:0/3559311612 learned_addr learned my addr 172.21.15.106:0/3559311612 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f15dec700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f1015e080 0x7f4f100c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.241 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f155eb700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 0x7f4f1015b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 -- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 msgr2=0x7f4f1015b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 0x7f4f1015b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 -- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f1015e080 msgr2=0x7f4f100c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f1015e080 0x7f4f100c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f14dea700 1 -- 172.21.15.106:0/3559311612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f08009b30 con 0x7f4f100ce430 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.235+0000 7f4f155eb700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 0x7f4f1015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f14dea700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000e810 tx=0x7f4f0000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00013610 con 0x7f4f100ce430 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f00013790 con 0x7f4f100ce430 2023-11-24T06:14:14.242 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f100b5320 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00013b40 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.236+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f100b58a0 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.237+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f10068fb0 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.237+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f00013ca0 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.238+0000 7f4f05ffb700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 0x7f4ef406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.238+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f00089150 con 0x7f4f100ce430 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.238+0000 7f4f155eb700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 0x7f4ef406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.238+0000 7f4f155eb700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 0x7f4ef406d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f101616c0 tx=0x7f4f0c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.242+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f00054290 con 0x7f4f100ce430 2023-11-24T06:14:14.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.434+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f100b5d50 con 0x7f4f100ce430 2023-11-24T06:14:14.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.434+0000 7f4f05ffb700 1 -- 172.21.15.106:0/3559311612 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f100b5d50 con 0x7f4f100ce430 2023-11-24T06:14:14.437 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 msgr2=0x7f4ef406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 0x7f4ef406d390 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f101616c0 tx=0x7f4f0c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 msgr2=0x7f4f1015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000e810 tx=0x7f4f0000eb20 comp rx=0 tx=0).stop 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 shutdown_connections 2023-11-24T06:14:14.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4ef406aed0 0x7f4ef406d390 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4f1015e080 0x7f4f100c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4f100b4310 0x7f4f1015b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 --2- 172.21.15.106:0/3559311612 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f100ce430 0x7f4f1015b070 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 >> 172.21.15.106:0/3559311612 conn(0x7f4f100b3780 msgr2=0x7f4f1006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 shutdown_connections 2023-11-24T06:14:14.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.436+0000 7f4f1784f700 1 -- 172.21.15.106:0/3559311612 wait complete. 2023-11-24T06:14:14.451 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:14.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.572+0000 7fae14395700 1 Processor -- start 2023-11-24T06:14:14.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.572+0000 7fae14395700 1 -- start start 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae14395700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae0c15e160 0x7fae0c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae14395700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0746a0 0x7fae0c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae14395700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0b3c60 con 0x7fae0c0afc90 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae14395700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0b4500 con 0x7fae0c15e160 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae14395700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0b58c0 con 0x7fae0c0746a0 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae0c15e160 0x7fae0c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae11930700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fae0c0afc90 0x7fae0c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39162/0 (socket says 172.21.15.106:39162) 2023-11-24T06:14:14.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae11930700 1 -- 172.21.15.106:0/2539475518 learned_addr learned my addr 172.21.15.106:0/2539475518 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fae0c15e160 0x7fae0c0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58898/0 (socket says 172.21.15.106:58898) 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 -- 172.21.15.106:0/2539475518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0746a0 msgr2=0x7fae0c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12932700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0746a0 0x7fae0c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae1112f700 1 -- 172.21.15.106:0/2539475518 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1611976291 0 0) 0x7fae0c0b3c60 con 0x7fae0c0afc90 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0746a0 0x7fae0c06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 -- 172.21.15.106:0/2539475518 >> v1:172.21.15.106:6789/0 conn(0x7fae0c0afc90 legacy=0x7fae0c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 -- 172.21.15.106:0/2539475518 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0b0140 con 0x7fae0c15e160 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae12131700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c15e160 0x7fae0c0b5da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009840 tx=0x7fadfc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56348f3b507e38b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae1112f700 1 -- 172.21.15.106:0/2539475518 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011830 con 0x7fae0c15e160 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae1112f700 1 -- 172.21.15.106:0/2539475518 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc011990 con 0x7fae0c15e160 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.573+0000 7fae1112f700 1 -- 172.21.15.106:0/2539475518 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc011d20 con 0x7fae0c15e160 2023-11-24T06:14:14.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 -- 172.21.15.106:0/2539475518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c15e160 msgr2=0x7fae0c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c15e160 0x7fae0c0b5da0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009840 tx=0x7fadfc009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 -- 172.21.15.106:0/2539475518 shutdown_connections 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0746a0 0x7fae0c06d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 --2- 172.21.15.106:0/2539475518 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c15e160 0x7fae0c0b5da0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 -- 172.21.15.106:0/2539475518 >> 172.21.15.106:0/2539475518 conn(0x7fae0c0d0bf0 msgr2=0x7fae0c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 -- 172.21.15.106:0/2539475518 shutdown_connections 2023-11-24T06:14:14.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.574+0000 7fae14395700 1 -- 172.21.15.106:0/2539475518 wait complete. 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.575+0000 7fae14395700 1 Processor -- start 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.575+0000 7fae14395700 1 -- start start 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 0x7fae0c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 0x7fae0c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0c84a0 con 0x7fae0c0746a0 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c15f770 con 0x7fae0c15e160 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae14395700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c15fa50 con 0x7fae0c0afc90 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.582 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58904/0 (socket says 172.21.15.106:58904) 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 -- 172.21.15.106:0/3641169440 learned_addr learned my addr 172.21.15.106:0/3641169440 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae11930700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 0x7fae0c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12932700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 0x7fae0c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 -- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 msgr2=0x7fae0c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 0x7fae0c1589a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 -- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 msgr2=0x7fae0c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 0x7fae0c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 -- 172.21.15.106:0/3641169440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0094a0 con 0x7fae0c0746a0 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12932700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 0x7fae0c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae11930700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 0x7fae0c1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:14.583 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.576+0000 7fae12131700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000c00 tx=0x7fadfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.577+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0038a0 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.577+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc01e070 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.577+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c1f3ea0 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.577+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc003c40 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.577+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c1f4400 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.578+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c068fb0 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.578+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fadfc01a420 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.579+0000 7fae02ffd700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 0x7fadf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.579+0000 7fae11930700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 0x7fadf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.579+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadfc08a7c0 con 0x7fae0c0746a0 2023-11-24T06:14:14.584 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.579+0000 7fae11930700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 0x7fadf006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0b3e10 tx=0x7fae08009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.585 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.583+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fadfc055860 con 0x7fae0c0746a0 2023-11-24T06:14:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.773+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fae0c06c120 con 0x7fae0c0746a0 2023-11-24T06:14:14.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.773+0000 7fae02ffd700 1 -- 172.21.15.106:0/3641169440 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fadfc015020 con 0x7fae0c0746a0 2023-11-24T06:14:14.776 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 msgr2=0x7fadf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 0x7fadf006d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fae0c0b3e10 tx=0x7fae08009040 comp rx=0 tx=0).stop 2023-11-24T06:14:14.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 msgr2=0x7fae0c1f3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fadfc000c00 tx=0x7fadfc004750 comp rx=0 tx=0).stop 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 shutdown_connections 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.775+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fadf006aed0 0x7fadf006d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fae0c15e160 0x7fae0c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae0c0746a0 0x7fae0c1f3960 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 --2- 172.21.15.106:0/3641169440 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fae0c0afc90 0x7fae0c1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 >> 172.21.15.106:0/3641169440 conn(0x7fae0c0d0bf0 msgr2=0x7fae0c15bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 shutdown_connections 2023-11-24T06:14:14.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.776+0000 7fae14395700 1 -- 172.21.15.106:0/3641169440 wait complete. 2023-11-24T06:14:14.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:14.912 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.910+0000 7f466d01a700 1 Processor -- start 2023-11-24T06:14:14.913 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.910+0000 7f466d01a700 1 -- start start 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.910+0000 7f466d01a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f46680b5e40 0x7f466806bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466d01a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f466815f8f0 0x7f466815fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466d01a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466806b750 con 0x7f4668145720 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466d01a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4668160870 con 0x7f46680b5e40 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466d01a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4668160590 con 0x7f466815f8f0 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f46680b5e40 0x7f466806bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f46680b5e40 0x7f466806bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58916/0 (socket says 172.21.15.106:58916) 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 -- 172.21.15.106:0/1036032874 learned_addr learned my addr 172.21.15.106:0/1036032874 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466759e700 1 --2- 172.21.15.106:0/1036032874 >> v2:172.21.15.176:3300/0 conn(0x7f466815f8f0 0x7f466815fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 -- 172.21.15.106:0/1036032874 >> v2:172.21.15.176:3300/0 conn(0x7f466815f8f0 msgr2=0x7f466815fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:14.915 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 --2- 172.21.15.106:0/1036032874 >> v2:172.21.15.176:3300/0 conn(0x7f466815f8f0 0x7f466815fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 -- 172.21.15.106:0/1036032874 >> v1:172.21.15.176:6789/0 conn(0x7f4668145720 legacy=0x7f46680b5730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 -- 172.21.15.106:0/1036032874 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466806b100 con 0x7f46680b5e40 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f466659c700 1 --2- 172.21.15.106:0/1036032874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46680b5e40 0x7f466806bbe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4668072d00 tx=0x7f465c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8b09a97a23ef12 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f4665d9b700 1 -- 172.21.15.106:0/1036032874 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c004230 con 0x7f46680b5e40 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f4665d9b700 1 -- 172.21.15.106:0/1036032874 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c004390 con 0x7f46680b5e40 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.911+0000 7f4665d9b700 1 -- 172.21.15.106:0/1036032874 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0036a0 con 0x7f46680b5e40 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 -- 172.21.15.106:0/1036032874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46680b5e40 msgr2=0x7f466806bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 --2- 172.21.15.106:0/1036032874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46680b5e40 0x7f466806bbe0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4668072d00 tx=0x7f465c009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 -- 172.21.15.106:0/1036032874 shutdown_connections 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 --2- 172.21.15.106:0/1036032874 >> v2:172.21.15.176:3300/0 conn(0x7f466815f8f0 0x7f466815fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 --2- 172.21.15.106:0/1036032874 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f46680b5e40 0x7f466806bbe0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 -- 172.21.15.106:0/1036032874 >> 172.21.15.106:0/1036032874 conn(0x7f46680d0be0 msgr2=0x7f46680d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:14.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 -- 172.21.15.106:0/1036032874 shutdown_connections 2023-11-24T06:14:14.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.912+0000 7f466d01a700 1 -- 172.21.15.106:0/1036032874 wait complete. 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.913+0000 7f466d01a700 1 Processor -- start 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.913+0000 7f466d01a700 1 -- start start 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 0x7f4668139c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f466815f8f0 0x7f466815add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466806f950 con 0x7f4668145720 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466815d7c0 con 0x7f466815f8f0 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466d01a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466815daa0 con 0x7f46680b5e40 2023-11-24T06:14:14.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58920/0 (socket says 172.21.15.106:58920) 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 -- 172.21.15.106:0/63961371 learned_addr learned my addr 172.21.15.106:0/63961371 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466759e700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f466815f8f0 0x7f466815add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f4666d9d700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 0x7f4668139c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 -- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 msgr2=0x7f4668139c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 0x7f4668139c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 -- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f466815f8f0 msgr2=0x7f466815add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f466815f8f0 0x7f466815add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f466659c700 1 -- 172.21.15.106:0/63961371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465c009550 con 0x7f4668145720 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.914+0000 7f4666d9d700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 0x7f4668139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f466659c700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f465c014040 tx=0x7f465c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c003d60 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c011630 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466815dd80 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c0119e0 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.915+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466815b310 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.916+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466815d900 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.916+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f465c011b40 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.917+0000 7f464f7fe700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 0x7f465406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.917+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f465c08a5d0 con 0x7f4668145720 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.917+0000 7f4666d9d700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 0x7f465406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:14.923 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.917+0000 7f4666d9d700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 0x7f465406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f46580099b0 tx=0x7f4658008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:14.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:14.921+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f466815d900 con 0x7f4668145720 2023-11-24T06:14:15.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.112+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f466815d900 con 0x7f4668145720 2023-11-24T06:14:15.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.112+0000 7f464f7fe700 1 -- 172.21.15.106:0/63961371 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f466815d900 con 0x7f4668145720 2023-11-24T06:14:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:15.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 msgr2=0x7f465406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 0x7f465406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f46580099b0 tx=0x7f4658008040 comp rx=0 tx=0).stop 2023-11-24T06:14:15.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 msgr2=0x7f466806f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f465c014040 tx=0x7f465c004750 comp rx=0 tx=0).stop 2023-11-24T06:14:15.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 shutdown_connections 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f465406aed0 0x7f465406d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f466815f8f0 0x7f466815add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f46680b5e40 0x7f4668139c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 --2- 172.21.15.106:0/63961371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4668145720 0x7f466806f410 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 >> 172.21.15.106:0/63961371 conn(0x7f46680d0be0 msgr2=0x7f46681403c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 shutdown_connections 2023-11-24T06:14:15.118 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.114+0000 7f466d01a700 1 -- 172.21.15.106:0/63961371 wait complete. 2023-11-24T06:14:15.130 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:15.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.247+0000 7f81d492a700 1 Processor -- start 2023-11-24T06:14:15.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.247+0000 7f81d492a700 1 -- start start 2023-11-24T06:14:15.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81d492a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81d015e080 0x7f81d00cc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81d492a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d00d1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81d492a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d00d0150 con 0x7f81d00ce910 2023-11-24T06:14:15.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81d492a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d015e460 con 0x7f81d015e080 2023-11-24T06:14:15.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81d492a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00cee50 con 0x7f81d00ce4d0 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81d015e080 0x7f81d00cc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81d015e080 0x7f81d00cc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58926/0 (socket says 172.21.15.106:58926) 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 -- 172.21.15.106:0/2027288211 learned_addr learned my addr 172.21.15.106:0/2027288211 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 -- 172.21.15.106:0/2027288211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 msgr2=0x7f81d00d1be0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 --2- 172.21.15.106:0/2027288211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d00d1be0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 -- 172.21.15.106:0/2027288211 >> v1:172.21.15.176:6789/0 conn(0x7f81d00ce910 legacy=0x7f81d00d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.248+0000 7f81ce59c700 1 -- 172.21.15.106:0/2027288211 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d00cf130 con 0x7f81d015e080 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81ce59c700 1 --2- 172.21.15.106:0/2027288211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d015e080 0x7f81d00cc2a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81c40098f0 tx=0x7f81c4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59b24560270ca43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81cd59a700 1 -- 172.21.15.106:0/2027288211 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c4004230 con 0x7f81d015e080 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81cd59a700 1 -- 172.21.15.106:0/2027288211 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c4004390 con 0x7f81d015e080 2023-11-24T06:14:15.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81cd59a700 1 -- 172.21.15.106:0/2027288211 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c40036a0 con 0x7f81d015e080 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 -- 172.21.15.106:0/2027288211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d015e080 msgr2=0x7f81d00cc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 --2- 172.21.15.106:0/2027288211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d015e080 0x7f81d00cc2a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f81c40098f0 tx=0x7f81c4009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 -- 172.21.15.106:0/2027288211 shutdown_connections 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 --2- 172.21.15.106:0/2027288211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d015e080 0x7f81d00cc2a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 --2- 172.21.15.106:0/2027288211 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d00d1be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 -- 172.21.15.106:0/2027288211 >> 172.21.15.106:0/2027288211 conn(0x7f81d0073130 msgr2=0x7f81d009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 -- 172.21.15.106:0/2027288211 shutdown_connections 2023-11-24T06:14:15.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.249+0000 7f81d492a700 1 -- 172.21.15.106:0/2027288211 wait complete. 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 Processor -- start 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 -- start start 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d009f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81d015e080 0x7f81d00c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c6700 con 0x7f81d00ce910 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c69e0 con 0x7f81d015e080 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.251+0000 7f81d492a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d00c6cc0 con 0x7f81d00ce4d0 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58930/0 (socket says 172.21.15.106:58930) 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 -- 172.21.15.106:0/2837288836 learned_addr learned my addr 172.21.15.106:0/2837288836 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81ce59c700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d009f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81ced9d700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81d015e080 0x7f81d00c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 -- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 msgr2=0x7f81d009f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d009f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 -- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81d015e080 msgr2=0x7f81d00c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81d015e080 0x7f81d00c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 -- 172.21.15.106:0/2837288836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4009550 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81cdd9b700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81c000b550 tx=0x7f81c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011830 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00119b0 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d00c6fa0 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0011d60 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.252+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d015c6d0 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.253+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d00cc760 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.254+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81c001a400 con 0x7f81d00ce910 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.254+0000 7f81beffd700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 0x7f81b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.254+0000 7f81ce59c700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 0x7f81b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.254+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81c0089620 con 0x7f81d00ce910 2023-11-24T06:14:15.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.254+0000 7f81ce59c700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 0x7f81b006d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009130 tx=0x7f81c4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.258+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81c0054760 con 0x7f81d00ce910 2023-11-24T06:14:15.469 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.467+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81d0067f60 con 0x7f81d00ce910 2023-11-24T06:14:15.470 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.467+0000 7f81beffd700 1 -- 172.21.15.106:0/2837288836 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f81c0057d80 con 0x7f81d00ce910 2023-11-24T06:14:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.469+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 msgr2=0x7f81b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.472 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 0x7f81b006d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009130 tx=0x7f81c4008030 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 msgr2=0x7f81d015c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f81c000b550 tx=0x7f81c000b910 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 shutdown_connections 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81b006aed0 0x7f81b006d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81d015e080 0x7f81d00c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81d00ce4d0 0x7f81d009f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 --2- 172.21.15.106:0/2837288836 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00ce910 0x7f81d015c190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 >> 172.21.15.106:0/2837288836 conn(0x7f81d0073130 msgr2=0x7f81d006fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 shutdown_connections 2023-11-24T06:14:15.473 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.470+0000 7f81d492a700 1 -- 172.21.15.106:0/2837288836 wait complete. 2023-11-24T06:14:15.474 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:15.484 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:14:15.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:15.484 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-24T06:14:15.536 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:14:15.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:15.536 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:14:15.561 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:15.561 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:15.583 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:15.583 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:15.643 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:15.643 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:15.702 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:15.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.819+0000 7fc23cbfa700 1 Processor -- start 2023-11-24T06:14:15.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.819+0000 7fc23cbfa700 1 -- start start 2023-11-24T06:14:15.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.820+0000 7fc23cbfa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 0x7fc2380726e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.820+0000 7fc23cbfa700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2380622a0 0x7fc238072c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.820+0000 7fc23cbfa700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2380adfd0 con 0x7fc2380af070 2023-11-24T06:14:15.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.820+0000 7fc23cbfa700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2380afbf0 con 0x7fc2380622a0 2023-11-24T06:14:15.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.820+0000 7fc23cbfa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380ae2b0 con 0x7fc23815c140 2023-11-24T06:14:15.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.822+0000 7fc235d9b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc2380622a0 0x7fc238072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.822+0000 7fc23659c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 0x7fc2380726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.822+0000 7fc236d9d700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fc2380af070 0x7fc2380af4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:33448/0 (socket says 172.21.15.106:33448) 2023-11-24T06:14:15.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.822+0000 7fc236d9d700 1 -- 172.21.15.106:0/2029144676 learned_addr learned my addr 172.21.15.106:0/2029144676 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:15.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.824+0000 7fc23659c700 1 -- 172.21.15.106:0/2029144676 >> v2:172.21.15.176:3300/0 conn(0x7fc2380622a0 msgr2=0x7fc238072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:15.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.824+0000 7fc23659c700 1 --2- 172.21.15.106:0/2029144676 >> v2:172.21.15.176:3300/0 conn(0x7fc2380622a0 0x7fc238072c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.824+0000 7fc23659c700 1 -- 172.21.15.106:0/2029144676 >> v1:172.21.15.176:6789/0 conn(0x7fc2380af070 legacy=0x7fc2380af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.824+0000 7fc23659c700 1 -- 172.21.15.106:0/2029144676 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2380ae590 con 0x7fc23815c140 2023-11-24T06:14:15.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.825+0000 7fc23659c700 1 --2- 172.21.15.106:0/2029144676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 0x7fc2380726e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc228009840 tx=0x7fc228009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658c8a2b4555a1d6 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.826+0000 7fc23559a700 1 -- 172.21.15.106:0/2029144676 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228011830 con 0x7fc23815c140 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.826+0000 7fc23559a700 1 -- 172.21.15.106:0/2029144676 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228011990 con 0x7fc23815c140 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.826+0000 7fc23559a700 1 -- 172.21.15.106:0/2029144676 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228011d20 con 0x7fc23815c140 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 -- 172.21.15.106:0/2029144676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 msgr2=0x7fc2380726e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/2029144676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 0x7fc2380726e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc228009840 tx=0x7fc228009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 -- 172.21.15.106:0/2029144676 shutdown_connections 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/2029144676 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc23815c140 0x7fc2380726e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/2029144676 >> v2:172.21.15.176:3300/0 conn(0x7fc2380622a0 0x7fc238072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 -- 172.21.15.106:0/2029144676 >> 172.21.15.106:0/2029144676 conn(0x7fc2380b57b0 msgr2=0x7fc2380b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:15.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 -- 172.21.15.106:0/2029144676 shutdown_connections 2023-11-24T06:14:15.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.827+0000 7fc23cbfa700 1 -- 172.21.15.106:0/2029144676 wait complete. 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.828+0000 7fc23cbfa700 1 Processor -- start 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.828+0000 7fc23cbfa700 1 -- start start 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 0x7fc238149990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2380af070 0x7fc23815a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380cbe90 con 0x7fc23815c140 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2380cccf0 con 0x7fc2380622a0 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23cbfa700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2381409c0 con 0x7fc2380af070 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58948/0 (socket says 172.21.15.106:58948) 2023-11-24T06:14:15.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 -- 172.21.15.106:0/3006646878 learned_addr learned my addr 172.21.15.106:0/3006646878 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23659c700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 0x7fc238149990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 -- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2380af070 msgr2=0x7fc23815a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2380af070 0x7fc23815a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 -- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 msgr2=0x7fc238149990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 0x7fc238149990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 -- 172.21.15.106:0/3006646878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280094a0 con 0x7fc23815c140 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc23659c700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 0x7fc238149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.829+0000 7fc236d9d700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc23000cbf0 tx=0x7fc2300021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.830+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23000ab40 con 0x7fc23815c140 2023-11-24T06:14:15.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.830+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23000aca0 con 0x7fc23815c140 2023-11-24T06:14:15.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.830+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2380cc0e0 con 0x7fc23815c140 2023-11-24T06:14:15.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.830+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230012600 con 0x7fc23815c140 2023-11-24T06:14:15.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.830+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2380cc6a0 con 0x7fc23815c140 2023-11-24T06:14:15.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.831+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2380cce80 con 0x7fc23815c140 2023-11-24T06:14:15.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.831+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc23001b3b0 con 0x7fc23815c140 2023-11-24T06:14:15.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.831+0000 7fc226ffd700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 0x7fc21806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:15.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.831+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2300891d0 con 0x7fc23815c140 2023-11-24T06:14:15.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.831+0000 7fc23659c700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 0x7fc21806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:15.836 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.832+0000 7fc23659c700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 0x7fc21806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc228014040 tx=0x7fc228008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:15.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:15.836+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc230054340 con 0x7fc23815c140 2023-11-24T06:14:16.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.028+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc238067f60 con 0x7fc23815c140 2023-11-24T06:14:16.032 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.029+0000 7fc226ffd700 1 -- 172.21.15.106:0/3006646878 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7fc230057960 con 0x7fc23815c140 2023-11-24T06:14:16.032 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:16.032 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:16.034 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 msgr2=0x7fc21806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 0x7fc21806d3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc228014040 tx=0x7fc228008030 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 msgr2=0x7fc238140480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc23000cbf0 tx=0x7fc2300021c0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 shutdown_connections 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc21806af00 0x7fc21806d3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc23815c140 0x7fc238140480 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc2380622a0 0x7fc238149990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 --2- 172.21.15.106:0/3006646878 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc2380af070 0x7fc23815a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.031+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 >> 172.21.15.106:0/3006646878 conn(0x7fc2380b57b0 msgr2=0x7fc2381596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.035 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.032+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 shutdown_connections 2023-11-24T06:14:16.036 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.032+0000 7fc23cbfa700 1 -- 172.21.15.106:0/3006646878 wait complete. 2023-11-24T06:14:16.046 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:16.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:16.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.169+0000 7fb9425c6700 1 Processor -- start 2023-11-24T06:14:16.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.169+0000 7fb9425c6700 1 -- start start 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb9425c6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb93c0aedc0 0x7fb93c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb9425c6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c15e290 0x7fb93c0af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb9425c6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb93c06e400 con 0x7fb93c0ad870 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb9425c6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb93c06fde0 con 0x7fb93c0aedc0 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb9425c6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c0af6e0 con 0x7fb93c15e290 2023-11-24T06:14:16.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb93c0aedc0 0x7fb93c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb93c0aedc0 0x7fb93c0ae790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58952/0 (socket says 172.21.15.106:58952) 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 -- 172.21.15.106:0/3694215218 learned_addr learned my addr 172.21.15.106:0/3694215218 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93b7fe700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c15e290 0x7fb93c0af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 -- 172.21.15.106:0/3694215218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c15e290 msgr2=0x7fb93c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c15e290 0x7fb93c0af1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 -- 172.21.15.106:0/3694215218 >> v1:172.21.15.176:6789/0 conn(0x7fb93c0ad870 legacy=0x7fb93c06f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 -- 172.21.15.106:0/3694215218 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb93c06e630 con 0x7fb93c0aedc0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93bfff700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c0aedc0 0x7fb93c0ae790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0098f0 tx=0x7fb92c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54547a5b9b31d0e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93affd700 1 -- 172.21.15.106:0/3694215218 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00b8a0 con 0x7fb93c0aedc0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93affd700 1 -- 172.21.15.106:0/3694215218 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c00ba00 con 0x7fb93c0aedc0 2023-11-24T06:14:16.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.170+0000 7fb93affd700 1 -- 172.21.15.106:0/3694215218 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c00bd90 con 0x7fb93c0aedc0 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 -- 172.21.15.106:0/3694215218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c0aedc0 msgr2=0x7fb93c0ae790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c0aedc0 0x7fb93c0ae790 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0098f0 tx=0x7fb92c009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 -- 172.21.15.106:0/3694215218 shutdown_connections 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c0aedc0 0x7fb93c0ae790 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 --2- 172.21.15.106:0/3694215218 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c15e290 0x7fb93c0af1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 -- 172.21.15.106:0/3694215218 >> 172.21.15.106:0/3694215218 conn(0x7fb93c0b2050 msgr2=0x7fb93c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 -- 172.21.15.106:0/3694215218 shutdown_connections 2023-11-24T06:14:16.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.171+0000 7fb9425c6700 1 -- 172.21.15.106:0/3694215218 wait complete. 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.172+0000 7fb9425c6700 1 Processor -- start 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.172+0000 7fb9425c6700 1 -- start start 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb93c0ad870 0x7fb93c14a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c0aedc0 0x7fb93c157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c159740 con 0x7fb93c15e290 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c158ac0 con 0x7fb93c0ad870 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb9425c6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb93c158da0 con 0x7fb93c0aedc0 2023-11-24T06:14:16.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb940b63700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb940b63700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58962/0 (socket says 172.21.15.106:58962) 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb940b63700 1 -- 172.21.15.106:0/2168619905 learned_addr learned my addr 172.21.15.106:0/2168619905 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb93b7fe700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c0aedc0 0x7fb93c157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.173+0000 7fb93bfff700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb93c0ad870 0x7fb93c14a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 -- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c0aedc0 msgr2=0x7fb93c157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c0aedc0 0x7fb93c157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 -- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb93c0ad870 msgr2=0x7fb93c14a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb93c0ad870 0x7fb93c14a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 -- 172.21.15.106:0/2168619905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c009550 con 0x7fb93c15e290 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb940b63700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb93400cbc0 tx=0x7fb93400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb934003c00 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb934003d60 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb93c159080 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400aae0 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.174+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb93c159b60 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.175+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb93c068d90 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.175+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb93400ac40 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.176+0000 7fb938ff9700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 0x7fb92806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.176+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb934089620 con 0x7fb93c15e290 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.176+0000 7fb93bfff700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 0x7fb92806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.176+0000 7fb93bfff700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 0x7fb92806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009c40 tx=0x7fb92c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.180+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb934054640 con 0x7fb93c15e290 2023-11-24T06:14:16.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.369+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb93c159880 con 0x7fb93c15e290 2023-11-24T06:14:16.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.370+0000 7fb938ff9700 1 -- 172.21.15.106:0/2168619905 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb93c159880 con 0x7fb93c15e290 2023-11-24T06:14:16.373 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 msgr2=0x7fb92806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 0x7fb92806d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009c40 tx=0x7fb92c008030 comp rx=0 tx=0).stop 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 msgr2=0x7fb93c1584b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb93400cbc0 tx=0x7fb93400ced0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 shutdown_connections 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb92806aed0 0x7fb92806d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb93c15e290 0x7fb93c1584b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb93c0ad870 0x7fb93c14a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 --2- 172.21.15.106:0/2168619905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb93c0aedc0 0x7fb93c157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 >> 172.21.15.106:0/2168619905 conn(0x7fb93c0b2050 msgr2=0x7fb93c1608b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 shutdown_connections 2023-11-24T06:14:16.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.372+0000 7fb9425c6700 1 -- 172.21.15.106:0/2168619905 wait complete. 2023-11-24T06:14:16.387 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:16.509 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.506+0000 7feddcb17700 1 Processor -- start 2023-11-24T06:14:16.509 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.506+0000 7feddcb17700 1 -- start start 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.507+0000 7feddcb17700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedd81587f0 0x7fedd806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.507+0000 7feddcb17700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fedd80b4370 0x7fedd815b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.507+0000 7feddcb17700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd806b530 con 0x7fedd815b370 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.507+0000 7feddcb17700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd80ae5e0 con 0x7fedd81587f0 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.507+0000 7feddcb17700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd815be30 con 0x7fedd80b4370 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedd81587f0 0x7fedd806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fedd81587f0 0x7fedd806aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58966/0 (socket says 172.21.15.106:58966) 2023-11-24T06:14:16.511 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 -- 172.21.15.106:0/1313969255 learned_addr learned my addr 172.21.15.106:0/1313969255 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd6d9d700 1 --2- 172.21.15.106:0/1313969255 >> v2:172.21.15.176:3300/0 conn(0x7fedd80b4370 0x7fedd815b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 -- 172.21.15.106:0/1313969255 >> v2:172.21.15.176:3300/0 conn(0x7fedd80b4370 msgr2=0x7fedd815b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 --2- 172.21.15.106:0/1313969255 >> v2:172.21.15.176:3300/0 conn(0x7fedd80b4370 0x7fedd815b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 -- 172.21.15.106:0/1313969255 >> v1:172.21.15.176:6789/0 conn(0x7fedd815b370 legacy=0x7fedd80b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 -- 172.21.15.106:0/1313969255 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd815c110 con 0x7fedd81587f0 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd659c700 1 --2- 172.21.15.106:0/1313969255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd81587f0 0x7fedd806aff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bb90 tx=0x7fedcc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fbe9c51f718f0fb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd559a700 1 -- 172.21.15.106:0/1313969255 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00dd10 con 0x7fedd81587f0 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd559a700 1 -- 172.21.15.106:0/1313969255 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc00de70 con 0x7fedd81587f0 2023-11-24T06:14:16.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.508+0000 7fedd559a700 1 -- 172.21.15.106:0/1313969255 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc004230 con 0x7fedd81587f0 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 -- 172.21.15.106:0/1313969255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd81587f0 msgr2=0x7fedd806aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 --2- 172.21.15.106:0/1313969255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd81587f0 0x7fedd806aff0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fedcc00bb90 tx=0x7fedcc00bea0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 -- 172.21.15.106:0/1313969255 shutdown_connections 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 --2- 172.21.15.106:0/1313969255 >> v2:172.21.15.176:3300/0 conn(0x7fedd80b4370 0x7fedd815b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 --2- 172.21.15.106:0/1313969255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd81587f0 0x7fedd806aff0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 -- 172.21.15.106:0/1313969255 >> 172.21.15.106:0/1313969255 conn(0x7fedd80d0bf0 msgr2=0x7fedd80d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 -- 172.21.15.106:0/1313969255 shutdown_connections 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.509+0000 7feddcb17700 1 -- 172.21.15.106:0/1313969255 wait complete. 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.510+0000 7feddcb17700 1 Processor -- start 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.510+0000 7feddcb17700 1 -- start start 2023-11-24T06:14:16.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd81587f0 0x7fedd81e62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd815b370 0x7fedd81e67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81e9da0 con 0x7fedd80b4370 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81e9190 con 0x7fedd815b370 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7feddcb17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd81e9470 con 0x7fedd81587f0 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58974/0 (socket says 172.21.15.106:58974) 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 -- 172.21.15.106:0/3747382260 learned_addr learned my addr 172.21.15.106:0/3747382260 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd5d9b700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd81587f0 0x7fedd81e62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd6d9d700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd815b370 0x7fedd81e67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 -- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd81587f0 msgr2=0x7fedd81e62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd81587f0 0x7fedd81e62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 -- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd815b370 msgr2=0x7fedd81e67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd815b370 0x7fedd81e67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.511+0000 7fedd659c700 1 -- 172.21.15.106:0/3747382260 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc00b7f0 con 0x7fedd80b4370 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7fedd659c700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d1730 tx=0x7fedcc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0045f0 con 0x7fedd80b4370 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc010670 con 0x7fedd80b4370 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd81e9750 con 0x7fedd80b4370 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc0109e0 con 0x7fedd80b4370 2023-11-24T06:14:16.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.512+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd81e8440 con 0x7fedd80b4370 2023-11-24T06:14:16.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.513+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd81e39f0 con 0x7fedd80b4370 2023-11-24T06:14:16.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.513+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedcc0193f0 con 0x7fedd80b4370 2023-11-24T06:14:16.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.513+0000 7fedc6ffd700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 0x7fedb806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.514+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedcc08b650 con 0x7fedd80b4370 2023-11-24T06:14:16.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.514+0000 7fedd5d9b700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 0x7fedb806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.514+0000 7fedd5d9b700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 0x7fedb806d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fedd815e490 tx=0x7fedc8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.518+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fedcc0566f0 con 0x7fedd80b4370 2023-11-24T06:14:16.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.706+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fedd815e4e0 con 0x7fedd80b4370 2023-11-24T06:14:16.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.707+0000 7fedc6ffd700 1 -- 172.21.15.106:0/3747382260 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fedcc006d80 con 0x7fedd80b4370 2023-11-24T06:14:16.710 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 msgr2=0x7fedb806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 0x7fedb806d3c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fedd815e490 tx=0x7fedc8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 msgr2=0x7fedd8148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedd80d1730 tx=0x7fedcc004750 comp rx=0 tx=0).stop 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 shutdown_connections 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fedb806af00 0x7fedb806d3c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedd815b370 0x7fedd81e67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fedd80b4370 0x7fedd8148780 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 --2- 172.21.15.106:0/3747382260 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedd81587f0 0x7fedd81e62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 >> 172.21.15.106:0/3747382260 conn(0x7fedd80d0bf0 msgr2=0x7fedd806e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 shutdown_connections 2023-11-24T06:14:16.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.709+0000 7feddcb17700 1 -- 172.21.15.106:0/3747382260 wait complete. 2023-11-24T06:14:16.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:16.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.843+0000 7f47e56d3700 1 Processor -- start 2023-11-24T06:14:16.846 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.843+0000 7f47e56d3700 1 -- start start 2023-11-24T06:14:16.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47e56d3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47e00b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47e56d3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00b2a60 con 0x7f47e00d05b0 2023-11-24T06:14:16.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47e56d3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e015e970 con 0x7f47e006e930 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47e56d3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e015ef30 con 0x7f47e015ac40 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47df7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f47e00d05b0 0x7f47e00ccfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39246/0 (socket says 172.21.15.106:39246) 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.844+0000 7f47df7fe700 1 -- 172.21.15.106:0/3247825738 learned_addr learned my addr 172.21.15.106:0/3247825738 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186871587 0 0) 0x7f47e00b2a60 con 0x7f47e00d05b0 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c80035b0 con 0x7f47e00d05b0 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 265918471 0 0) 0x7f47c80035b0 con 0x7f47e00d05b0 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 msgr2=0x7f47e00b42d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47e00b42d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 >> v1:172.21.15.176:6789/0 conn(0x7f47e006e930 legacy=0x7f47e00cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.851 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00b2cb0 con 0x7f47e00d05b0 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f47d80019f0 con 0x7f47e00d05b0 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 >> v1:172.21.15.106:6789/0 conn(0x7f47e00d05b0 legacy=0x7f47e00ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47c8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c8004140 0x7f47c8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8004eb0 0x7f47c800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e015ef30 con 0x7f47c8004eb0 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c8005630 con 0x7f47c8004140 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47c800bf50 con 0x7f47e015ac40 2023-11-24T06:14:16.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8004eb0 0x7f47c800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47deffd700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47c8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 -- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 msgr2=0x7f47c8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47c8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 -- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c8004140 msgr2=0x7f47c8004850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47c8004140 0x7f47c8004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47df7fe700 1 -- 172.21.15.106:0/3247825738 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80035b0 con 0x7f47c8004eb0 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.845+0000 7f47deffd700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e015ac40 0x7f47c8003a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47df7fe700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8004eb0 0x7f47c800ba10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47d800a850 tx=0x7f47c8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6a9a90cdecb6fe server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.854 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8012600 con 0x7f47c8004eb0 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d8012780 con 0x7f47c8004eb0 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47ddffb700 1 -- 172.21.15.106:0/3247825738 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8012b30 con 0x7f47c8004eb0 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 -- 172.21.15.106:0/3247825738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8004eb0 msgr2=0x7f47c800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 --2- 172.21.15.106:0/3247825738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47c8004eb0 0x7f47c800ba10 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f47d800a850 tx=0x7f47c8005880 comp rx=0 tx=0).stop 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47df7fe700 1 -- 172.21.15.106:0/3247825738 reap_dead start 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 -- 172.21.15.106:0/3247825738 shutdown_connections 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 -- 172.21.15.106:0/3247825738 >> 172.21.15.106:0/3247825738 conn(0x7f47e006b410 msgr2=0x7f47e006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 -- 172.21.15.106:0/3247825738 shutdown_connections 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.846+0000 7f47e56d3700 1 -- 172.21.15.106:0/3247825738 wait complete. 2023-11-24T06:14:16.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 Processor -- start 2023-11-24T06:14:16.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 -- start start 2023-11-24T06:14:16.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47e00b11d0 0x7f47e00cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e00c8850 0x7f47e01f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00c8ce0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00c8fc0 con 0x7f47e00b11d0 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.848+0000 7f47e56d3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00c92a0 con 0x7f47e00c8850 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:58996/0 (socket says 172.21.15.106:58996) 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 -- 172.21.15.106:0/4092189696 learned_addr learned my addr 172.21.15.106:0/4092189696 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 -- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e00c8850 msgr2=0x7f47e01f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47deffd700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47e00b11d0 0x7f47e00cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47de7fc700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e00c8850 0x7f47e01f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e00c8850 0x7f47e01f3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 -- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47e00b11d0 msgr2=0x7f47e00cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47e00b11d0 0x7f47e00cab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 -- 172.21.15.106:0/4092189696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00c9580 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47df7fe700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001cb0 tx=0x7f47d8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d8021070 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d80019c0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e00c4fd0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d801a4c0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.849+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e00c9ca0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.850+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e00c5340 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.851+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f47d801a620 con 0x7f47e00cb0a0 2023-11-24T06:14:16.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.851+0000 7f47c77fe700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 0x7f47cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:16.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.852+0000 7f47deffd700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 0x7f47cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:16.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.852+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d808c5e0 con 0x7f47e00cb0a0 2023-11-24T06:14:16.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.852+0000 7f47deffd700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 0x7f47cc06d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47d40096d0 tx=0x7f47d4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:16.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:16.855+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f47d8057720 con 0x7f47e00cb0a0 2023-11-24T06:14:17.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.044+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47e0068480 con 0x7f47e00cb0a0 2023-11-24T06:14:17.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.045+0000 7f47c77fe700 1 -- 172.21.15.106:0/4092189696 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47d805ad40 con 0x7f47e00cb0a0 2023-11-24T06:14:17.048 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 msgr2=0x7f47cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 0x7f47cc06d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f47d40096d0 tx=0x7f47d4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 msgr2=0x7f47e01f43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f47d8001cb0 tx=0x7f47d8001d80 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 shutdown_connections 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f47cc06aed0 0x7f47cc06d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47e00cb0a0 0x7f47e01f43a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f47e00b11d0 0x7f47e00cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 --2- 172.21.15.106:0/4092189696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f47e00c8850 0x7f47e01f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 >> 172.21.15.106:0/4092189696 conn(0x7f47e006b410 msgr2=0x7f47e00ce770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 shutdown_connections 2023-11-24T06:14:17.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.047+0000 7f47e56d3700 1 -- 172.21.15.106:0/4092189696 wait complete. 2023-11-24T06:14:17.062 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:17.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.182+0000 7f085f53e700 1 Processor -- start 2023-11-24T06:14:17.184 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.182+0000 7f085f53e700 1 -- start start 2023-11-24T06:14:17.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085f53e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085f53e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08580af4d0 0x7f08580afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085f53e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08580ae430 con 0x7f085806c000 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085f53e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580af0b0 con 0x7f08580af4d0 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085f53e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b05a0 con 0x7f085815e080 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:41220/0 (socket says 172.21.15.106:41220) 2023-11-24T06:14:17.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 -- 172.21.15.106:0/2883620519 learned_addr learned my addr 172.21.15.106:0/2883620519 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 -- 172.21.15.106:0/2883620519 >> v2:172.21.15.176:3300/0 conn(0x7f08580af4d0 msgr2=0x7f08580afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 --2- 172.21.15.106:0/2883620519 >> v2:172.21.15.176:3300/0 conn(0x7f08580af4d0 0x7f08580afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 -- 172.21.15.106:0/2883620519 >> v1:172.21.15.176:6789/0 conn(0x7f085806c000 legacy=0x7f0858073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.183+0000 7f085d2da700 1 -- 172.21.15.106:0/2883620519 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580ae710 con 0x7f085815e080 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085d2da700 1 --2- 172.21.15.106:0/2883620519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08480098f0 tx=0x7f0848009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a661ebfa3411dc1f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f084ffff700 1 -- 172.21.15.106:0/2883620519 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848004230 con 0x7f085815e080 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f084ffff700 1 -- 172.21.15.106:0/2883620519 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848004390 con 0x7f085815e080 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f084ffff700 1 -- 172.21.15.106:0/2883620519 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480036a0 con 0x7f085815e080 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 -- 172.21.15.106:0/2883620519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 msgr2=0x7f08580b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 --2- 172.21.15.106:0/2883620519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f08480098f0 tx=0x7f0848009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:17.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 -- 172.21.15.106:0/2883620519 shutdown_connections 2023-11-24T06:14:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 --2- 172.21.15.106:0/2883620519 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f085815e080 0x7f08580b5050 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 --2- 172.21.15.106:0/2883620519 >> v2:172.21.15.176:3300/0 conn(0x7f08580af4d0 0x7f08580afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 -- 172.21.15.106:0/2883620519 >> 172.21.15.106:0/2883620519 conn(0x7f0858071b90 msgr2=0x7f0858071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 -- 172.21.15.106:0/2883620519 shutdown_connections 2023-11-24T06:14:17.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.184+0000 7f085f53e700 1 -- 172.21.15.106:0/2883620519 wait complete. 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 Processor -- start 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 -- start start 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08580af4d0 0x7f08581513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085815e080 0x7f08581518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085815fd30 con 0x7f085806c000 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858151e30 con 0x7f085815e080 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085f53e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085814cca0 con 0x7f08580af4d0 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085d2da700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085d2da700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59004/0 (socket says 172.21.15.106:59004) 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.186+0000 7f085d2da700 1 -- 172.21.15.106:0/3894616217 learned_addr learned my addr 172.21.15.106:0/3894616217 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085dadb700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085815e080 0x7f08581518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 -- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08580af4d0 msgr2=0x7f08581513b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08580af4d0 0x7f08581513b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 -- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085815e080 msgr2=0x7f08581518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085815e080 0x7f08581518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 -- 172.21.15.106:0/3894616217 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009550 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085d2da700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f084800b0e0 tx=0x7f0848004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800b660 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800b7e0 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085814f040 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800bb90 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.187+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085814f850 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.188+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580753f0 con 0x7f085806c000 2023-11-24T06:14:17.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.189+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f084800bcf0 con 0x7f085806c000 2023-11-24T06:14:17.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.189+0000 7f084dffb700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 0x7f083c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.189+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f084808ae70 con 0x7f085806c000 2023-11-24T06:14:17.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.189+0000 7f085cad9700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 0x7f083c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.190+0000 7f085cad9700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 0x7f083c06d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08581f73b0 tx=0x7f0854006cb0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.194+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0848055fb0 con 0x7f085806c000 2023-11-24T06:14:17.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.399+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0858067f60 con 0x7f085806c000 2023-11-24T06:14:17.402 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.399+0000 7f084dffb700 1 -- 172.21.15.106:0/3894616217 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f08480595d0 con 0x7f085806c000 2023-11-24T06:14:17.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 msgr2=0x7f083c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 0x7f083c06d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08581f73b0 tx=0x7f0854006cb0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 msgr2=0x7f085814c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f084800b0e0 tx=0x7f0848004750 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 shutdown_connections 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f083c06aed0 0x7f083c06d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f085815e080 0x7f08581518f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f085806c000 0x7f085814c760 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 --2- 172.21.15.106:0/3894616217 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08580af4d0 0x7f08581513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 >> 172.21.15.106:0/3894616217 conn(0x7f0858071b90 msgr2=0x7f0858073f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 shutdown_connections 2023-11-24T06:14:17.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.401+0000 7f085f53e700 1 -- 172.21.15.106:0/3894616217 wait complete. 2023-11-24T06:14:17.406 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:17.416 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:14:17.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:17.416 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-11-24T06:14:17.470 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:14:17.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:17.470 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:14:17.523 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:17.524 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:17.541 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:17.541 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:17.599 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:17.599 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:17.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.813+0000 7f6db7793700 1 Processor -- start 2023-11-24T06:14:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.814+0000 7f6db7793700 1 -- start start 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.814+0000 7f6db7793700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db015c160 0x7f6db00622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.814+0000 7f6db7793700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6db00b04b0 0x7f6db0165c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.814+0000 7f6db7793700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db015c540 con 0x7f6db00b2870 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.814+0000 7f6db7793700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db00b2cf0 con 0x7f6db00b04b0 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db7793700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db00b2ee0 con 0x7f6db015c160 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6db00b04b0 0x7f6db0165c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6db00b04b0 0x7f6db0165c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59016/0 (socket says 172.21.15.106:59016) 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 -- 172.21.15.106:0/467526905 learned_addr learned my addr 172.21.15.106:0/467526905 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db552f700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db015c160 0x7f6db00622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 -- 172.21.15.106:0/467526905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db015c160 msgr2=0x7f6db00622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db015c160 0x7f6db00622a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 -- 172.21.15.106:0/467526905 >> v1:172.21.15.176:6789/0 conn(0x7f6db00b2870 legacy=0x7f6db00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 -- 172.21.15.106:0/467526905 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00add40 con 0x7f6db00b04b0 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6db5d30700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db00b04b0 0x7f6db0165c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=645a59ffbe2d7189 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6da7fff700 1 -- 172.21.15.106:0/467526905 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800e070 con 0x7f6db00b04b0 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6da7fff700 1 -- 172.21.15.106:0/467526905 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800b9c0 con 0x7f6db00b04b0 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.815+0000 7f6da7fff700 1 -- 172.21.15.106:0/467526905 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800bd70 con 0x7f6db00b04b0 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 -- 172.21.15.106:0/467526905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db00b04b0 msgr2=0x7f6db0165c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db00b04b0 0x7f6db0165c80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f6da8009e50 tx=0x7f6da800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 -- 172.21.15.106:0/467526905 shutdown_connections 2023-11-24T06:14:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db015c160 0x7f6db00622a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 --2- 172.21.15.106:0/467526905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db00b04b0 0x7f6db0165c80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 -- 172.21.15.106:0/467526905 >> 172.21.15.106:0/467526905 conn(0x7f6db00b57b0 msgr2=0x7f6db00b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 -- 172.21.15.106:0/467526905 shutdown_connections 2023-11-24T06:14:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.816+0000 7f6db7793700 1 -- 172.21.15.106:0/467526905 wait complete. 2023-11-24T06:14:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.817+0000 7f6db7793700 1 Processor -- start 2023-11-24T06:14:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.817+0000 7f6db7793700 1 -- start start 2023-11-24T06:14:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6db00b04b0 0x7f6db015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db00b2870 0x7f6db014d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db014d800 con 0x7f6db015c160 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01f7b10 con 0x7f6db00b04b0 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db7793700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01f7df0 con 0x7f6db00b2870 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59022/0 (socket says 172.21.15.106:59022) 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 -- 172.21.15.106:0/330153630 learned_addr learned my addr 172.21.15.106:0/330153630 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db552f700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6db00b04b0 0x7f6db015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db4d2e700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db00b2870 0x7f6db014d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 -- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db00b2870 msgr2=0x7f6db014d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db00b2870 0x7f6db014d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.824 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 -- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6db00b04b0 msgr2=0x7f6db015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6db00b04b0 0x7f6db015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.818+0000 7f6db5d30700 1 -- 172.21.15.106:0/330153630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009b30 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6db5d30700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6da8012000 tx=0x7f6da8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8004800 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da8004960 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db01f80d0 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da801c680 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.819+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db01f88d0 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.820+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db00b6390 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.820+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6da801c7e0 con 0x7f6db015c160 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.821+0000 7f6da5ffb700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 0x7f6d9406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:17.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.821+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6da808ae40 con 0x7f6db015c160 2023-11-24T06:14:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.821+0000 7f6db552f700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 0x7f6d9406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:17.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.821+0000 7f6db552f700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 0x7f6d9406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6da0006b20 tx=0x7f6da0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:17.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:17.825+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6da8055f80 con 0x7f6db015c160 2023-11-24T06:14:18.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.021+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6db0067f60 con 0x7f6db015c160 2023-11-24T06:14:18.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.022+0000 7f6da5ffb700 1 -- 172.21.15.106:0/330153630 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f6da80595a0 con 0x7f6db015c160 2023-11-24T06:14:18.025 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:18.025 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 msgr2=0x7f6d9406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 0x7f6d9406d390 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6da0006b20 tx=0x7f6da0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 msgr2=0x7f6db00c9640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6da8012000 tx=0x7f6da8004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 shutdown_connections 2023-11-24T06:14:18.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6d9406aed0 0x7f6d9406d390 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6db015c160 0x7f6db00c9640 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6db00b04b0 0x7f6db015c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 --2- 172.21.15.106:0/330153630 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6db00b2870 0x7f6db014d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 >> 172.21.15.106:0/330153630 conn(0x7f6db00b57b0 msgr2=0x7f6db00726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 shutdown_connections 2023-11-24T06:14:18.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.024+0000 7f6db7793700 1 -- 172.21.15.106:0/330153630 wait complete. 2023-11-24T06:14:18.039 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:18.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:18.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.159+0000 7f29461c7700 1 Processor -- start 2023-11-24T06:14:18.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.159+0000 7f29461c7700 1 -- start start 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f29461c7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 0x7f29400b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f29461c7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f29400746a0 0x7f294006d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f29461c7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29400b3c60 con 0x7f29400afc90 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f29461c7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29400b4500 con 0x7f29400746a0 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f29461c7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b58c0 con 0x7f294015e160 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f293effd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29400afc90 0x7f2940073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39290/0 (socket says 172.21.15.106:39290) 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.160+0000 7f293effd700 1 -- 172.21.15.106:0/565526175 learned_addr learned my addr 172.21.15.106:0/565526175 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:18.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469115431 0 0) 0x7f29400b3c60 con 0x7f29400afc90 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 --2- 172.21.15.106:0/565526175 >> v2:172.21.15.176:3300/0 conn(0x7f29400746a0 0x7f294006d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29280035b0 con 0x7f29400afc90 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910324435 0 0) 0x7f29280035b0 con 0x7f29400afc90 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 msgr2=0x7f29400b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 0x7f29400b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 >> v2:172.21.15.176:3300/0 conn(0x7f29400746a0 msgr2=0x7f294006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 --2- 172.21.15.106:0/565526175 >> v2:172.21.15.176:3300/0 conn(0x7f29400746a0 0x7f294006d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294006bdc0 con 0x7f29400afc90 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f2930001670 con 0x7f29400afc90 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 >> v1:172.21.15.106:6789/0 conn(0x7f29400afc90 legacy=0x7f2940073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2928003a00 0x7f2928003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 0x7f2928004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928004d90 0x7f2928005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b4500 con 0x7f2928004d90 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400b58c0 con 0x7f2928003a00 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f292800bba0 con 0x7f294015e160 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928004d90 0x7f2928005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 -- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 msgr2=0x7f2928004850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f294015e160 0x7f2928004850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 -- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2928003a00 msgr2=0x7f2928003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2928003a00 0x7f2928003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 -- 172.21.15.106:0/565526175 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29280035b0 con 0x7f2928004d90 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.161+0000 7f293ffff700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928004d90 0x7f2928005210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2938007330 tx=0x7f2928005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb0062b3c0d8103 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938007e50 con 0x7f2928004d90 2023-11-24T06:14:18.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2938014400 con 0x7f2928004d90 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f293e7fc700 1 -- 172.21.15.106:0/565526175 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29380147b0 con 0x7f2928004d90 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 -- 172.21.15.106:0/565526175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928004d90 msgr2=0x7f2928005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 --2- 172.21.15.106:0/565526175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2928004d90 0x7f2928005210 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2938007330 tx=0x7f2928005880 comp rx=0 tx=0).stop 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f293ffff700 1 -- 172.21.15.106:0/565526175 reap_dead start 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 -- 172.21.15.106:0/565526175 shutdown_connections 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 -- 172.21.15.106:0/565526175 >> 172.21.15.106:0/565526175 conn(0x7f29400d0bf0 msgr2=0x7f29400d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 -- 172.21.15.106:0/565526175 shutdown_connections 2023-11-24T06:14:18.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.162+0000 7f29461c7700 1 -- 172.21.15.106:0/565526175 wait complete. 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.164+0000 7f29461c7700 1 Processor -- start 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.164+0000 7f29461c7700 1 -- start start 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 0x7f29400c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29401f6f90 0x7f29400c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400c79c0 con 0x7f29400c6110 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29400c8150 con 0x7f29401f6f90 2023-11-24T06:14:18.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f29461c7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2940159260 con 0x7f29400c6d50 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59042/0 (socket says 172.21.15.106:59042) 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 -- 172.21.15.106:0/2345321087 learned_addr learned my addr 172.21.15.106:0/2345321087 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293effd700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29401f6f90 0x7f29400c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293f7fe700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 0x7f29400c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 -- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 msgr2=0x7f29400c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 0x7f29400c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 -- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29401f6f90 msgr2=0x7f29400c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29401f6f90 0x7f29400c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 -- 172.21.15.106:0/2345321087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29401f7490 con 0x7f29400c6110 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293f7fe700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 0x7f29400c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f293ffff700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2938014000 tx=0x7f2938004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.165+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2938007000 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.166+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293801e410 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.166+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29401f7770 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.166+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293801e7c0 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.166+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29401f7d30 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.166+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2940068fb0 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.167+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f293801b050 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.167+0000 7f2927fff700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 0x7f292c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.167+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f293808a8c0 con 0x7f29400c6110 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.167+0000 7f293f7fe700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 0x7f292c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.168+0000 7f293f7fe700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 0x7f292c06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2934006fd0 tx=0x7f2934008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.172+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2938055b20 con 0x7f29400c6110 2023-11-24T06:14:18.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.360+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f294006c140 con 0x7f29400c6110 2023-11-24T06:14:18.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.360+0000 7f2927fff700 1 -- 172.21.15.106:0/2345321087 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2938059140 con 0x7f29400c6110 2023-11-24T06:14:18.363 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:18.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.362+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 msgr2=0x7f292c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.362+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 0x7f292c06d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2934006fd0 tx=0x7f2934008040 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.362+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 msgr2=0x7f29400adfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.362+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f2938014000 tx=0x7f2938004b40 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 shutdown_connections 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f292c06aed0 0x7f292c06d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29400c6110 0x7f29400adfe0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f29400c6d50 0x7f29400c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 --2- 172.21.15.106:0/2345321087 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f29401f6f90 0x7f29400c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 >> 172.21.15.106:0/2345321087 conn(0x7f29400d0bf0 msgr2=0x7f294015b470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 shutdown_connections 2023-11-24T06:14:18.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.363+0000 7f29461c7700 1 -- 172.21.15.106:0/2345321087 wait complete. 2023-11-24T06:14:18.377 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:18.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.497+0000 7f9e9edf3700 1 Processor -- start 2023-11-24T06:14:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.497+0000 7f9e9edf3700 1 -- start start 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e9edf3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e980afb40 0x7f9e980cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e9edf3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9e980cfa80 0x7f9e9806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e9edf3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e980cccd0 con 0x7f9e9815ada0 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e9edf3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980cd2e0 con 0x7f9e980afb40 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e9edf3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e980cd5c0 con 0x7f9e980cfa80 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e980afb40 0x7f9e980cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9e980afb40 0x7f9e980cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59048/0 (socket says 172.21.15.106:59048) 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 -- 172.21.15.106:0/4163624803 learned_addr learned my addr 172.21.15.106:0/4163624803 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 -- 172.21.15.106:0/4163624803 >> v2:172.21.15.176:3300/0 conn(0x7f9e980cfa80 msgr2=0x7f9e9806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 --2- 172.21.15.106:0/4163624803 >> v2:172.21.15.176:3300/0 conn(0x7f9e980cfa80 0x7f9e9806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 -- 172.21.15.106:0/4163624803 >> v1:172.21.15.176:6789/0 conn(0x7f9e9815ada0 legacy=0x7f9e9806f810 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 -- 172.21.15.106:0/4163624803 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e98062440 con 0x7f9e980afb40 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e97fff700 1 --2- 172.21.15.106:0/4163624803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980afb40 0x7f9e980cf540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e980b30f0 tx=0x7f9e8400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88b0f492108244c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e977fe700 1 -- 172.21.15.106:0/4163624803 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400dcf0 con 0x7f9e980afb40 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e977fe700 1 -- 172.21.15.106:0/4163624803 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e8400de50 con 0x7f9e980afb40 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.498+0000 7f9e977fe700 1 -- 172.21.15.106:0/4163624803 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004250 con 0x7f9e980afb40 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 -- 172.21.15.106:0/4163624803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980afb40 msgr2=0x7f9e980cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/4163624803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980afb40 0x7f9e980cf540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e980b30f0 tx=0x7f9e8400be70 comp rx=0 tx=0).stop 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 -- 172.21.15.106:0/4163624803 shutdown_connections 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/4163624803 >> v2:172.21.15.176:3300/0 conn(0x7f9e980cfa80 0x7f9e9806d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/4163624803 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980afb40 0x7f9e980cf540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 -- 172.21.15.106:0/4163624803 >> 172.21.15.106:0/4163624803 conn(0x7f9e980b2050 msgr2=0x7f9e980b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 -- 172.21.15.106:0/4163624803 shutdown_connections 2023-11-24T06:14:18.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.499+0000 7f9e9edf3700 1 -- 172.21.15.106:0/4163624803 wait complete. 2023-11-24T06:14:18.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.500+0000 7f9e9edf3700 1 Processor -- start 2023-11-24T06:14:18.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.500+0000 7f9e9edf3700 1 -- start start 2023-11-24T06:14:18.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e980afb40 0x7f9e9814d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.506 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e9815ada0 0x7f9e9814ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814a260 con 0x7f9e980cfa80 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814f4b0 con 0x7f9e9815ada0 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e9edf3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9814df30 con 0x7f9e980afb40 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59054/0 (socket says 172.21.15.106:59054) 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 -- 172.21.15.106:0/1605513451 learned_addr learned my addr 172.21.15.106:0/1605513451 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 -- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e980afb40 msgr2=0x7f9e9814d950 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e980afb40 0x7f9e9814d950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 -- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e9815ada0 msgr2=0x7f9e9814ef70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e9815ada0 0x7f9e9814ef70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.501+0000 7f9e97fff700 1 -- 172.21.15.106:0/1605513451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8400b7f0 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e97fff700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e84000c00 tx=0x7f9e84004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84020070 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84004030 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e9814e210 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84010470 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.502+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e9814e7d0 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.503+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e840193f0 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.503+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e98068d90 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.503+0000 7f9e957fa700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 0x7f9e7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.503+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e8408cc10 con 0x7f9e980cfa80 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.504+0000 7f9e9cb8f700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 0x7f9e7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.504+0000 7f9e9cb8f700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 0x7f9e7c06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c006fd0 tx=0x7f9e8c006bc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.508+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e84057d50 con 0x7f9e980cfa80 2023-11-24T06:14:18.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.698+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e981ef3f0 con 0x7f9e980cfa80 2023-11-24T06:14:18.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.698+0000 7f9e957fa700 1 -- 172.21.15.106:0/1605513451 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e8405b370 con 0x7f9e980cfa80 2023-11-24T06:14:18.701 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:18.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.700+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 msgr2=0x7f9e7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.700+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 0x7f9e7c06d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c006fd0 tx=0x7f9e8c006bc0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.700+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 msgr2=0x7f9e98149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.700+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9e84000c00 tx=0x7f9e84004750 comp rx=0 tx=0).stop 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 shutdown_connections 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9e7c06aed0 0x7f9e7c06d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9e9815ada0 0x7f9e9814ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9e980afb40 0x7f9e9814d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 --2- 172.21.15.106:0/1605513451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e980cfa80 0x7f9e98149d20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 >> 172.21.15.106:0/1605513451 conn(0x7f9e980b2050 msgr2=0x7f9e980b3140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 shutdown_connections 2023-11-24T06:14:18.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.701+0000 7f9e9edf3700 1 -- 172.21.15.106:0/1605513451 wait complete. 2023-11-24T06:14:18.715 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:18.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.835+0000 7f496a880700 1 Processor -- start 2023-11-24T06:14:18.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.835+0000 7f496a880700 1 -- start start 2023-11-24T06:14:18.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f496a880700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f496415ba30 0x7f496406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f496a880700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496415f280 con 0x7f4964162800 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f496a880700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4964161d20 con 0x7f496415ec50 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f496a880700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496415f090 con 0x7f496415ba30 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f49637fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4964162800 0x7f496415e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39322/0 (socket says 172.21.15.106:39322) 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.836+0000 7f49637fe700 1 -- 172.21.15.106:0/591979587 learned_addr learned my addr 172.21.15.106:0/591979587 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3073562102 0 0) 0x7f496415f280 con 0x7f4964162800 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f494c0035b0 con 0x7f4964162800 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 147817745 0 0) 0x7f494c0035b0 con 0x7f4964162800 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 >> v2:172.21.15.176:3300/0 conn(0x7f496415ba30 msgr2=0x7f496406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 --2- 172.21.15.106:0/591979587 >> v2:172.21.15.176:3300/0 conn(0x7f496415ba30 0x7f496406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 >> v1:172.21.15.176:6789/0 conn(0x7f496415ec50 legacy=0x7f496406e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964162000 con 0x7f4964162800 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f4954001670 con 0x7f4964162800 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 >> v1:172.21.15.106:6789/0 conn(0x7f4964162800 legacy=0x7f496415e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f494c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c004850 0x7f494c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c005330 0x7f494c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c00c200 con 0x7f494c003a00 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494c00c370 con 0x7f494c004850 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f494c00c530 con 0x7f494c005330 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f494c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 -- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c005330 msgr2=0x7f494c00ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f494c005330 0x7f494c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 -- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c004850 msgr2=0x7f494c004cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f494c004850 0x7f494c004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 -- 172.21.15.106:0/591979587 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f494c0035b0 con 0x7f494c003a00 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4968e1d700 1 -- 172.21.15.106:0/591979587 reap_dead start 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4963fff700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f494c003e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49580098e0 tx=0x7f494c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82f5c5499f01f59f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958004230 con 0x7f494c003a00 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.837+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580043b0 con 0x7f494c003a00 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f4962ffd700 1 -- 172.21.15.106:0/591979587 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580038c0 con 0x7f494c003a00 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 -- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 msgr2=0x7f494c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f494c003e00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f49580098e0 tx=0x7f494c005880 comp rx=0 tx=0).stop 2023-11-24T06:14:18.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 -- 172.21.15.106:0/591979587 shutdown_connections 2023-11-24T06:14:18.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 --2- 172.21.15.106:0/591979587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f494c003e00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 -- 172.21.15.106:0/591979587 >> 172.21.15.106:0/591979587 conn(0x7f4964071a70 msgr2=0x7f4964071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:18.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 -- 172.21.15.106:0/591979587 shutdown_connections 2023-11-24T06:14:18.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.838+0000 7f496a880700 1 -- 172.21.15.106:0/591979587 wait complete. 2023-11-24T06:14:18.845 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.839+0000 7f496a880700 1 Processor -- start 2023-11-24T06:14:18.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.839+0000 7f496a880700 1 -- start start 2023-11-24T06:14:18.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49641f37d0 0x7f49640b52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49640b57f0 0x7f49640cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640b66e0 con 0x7f494c003a00 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640c5d30 con 0x7f49640b57f0 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f496a880700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640cd650 con 0x7f49641f37d0 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f4963fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f4963fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59070/0 (socket says 172.21.15.106:59070) 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.840+0000 7f4963fff700 1 -- 172.21.15.106:0/2649861404 learned_addr learned my addr 172.21.15.106:0/2649861404 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 -- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49641f37d0 msgr2=0x7f49640b52b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49641f37d0 0x7f49640b52b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 -- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49640b57f0 msgr2=0x7f49640cddc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49640b57f0 0x7f49640cddc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 -- 172.21.15.106:0/2649861404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496415bf90 con 0x7f494c003a00 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4963fff700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4958007fd0 tx=0x7f4958004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4958011dc0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49580253f0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49580257a0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49641f3f30 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.841+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49641f44f0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.842+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4964068fb0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.842+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4958025900 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.842+0000 7f4960ff9700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 0x7f495006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.843+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f495808a6e0 con 0x7f494c003a00 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.843+0000 7f49637fe700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 0x7f495006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:18.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.843+0000 7f49637fe700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 0x7f495006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4954001820 tx=0x7f4954001450 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:18.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:18.847+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4958055940 con 0x7f494c003a00 2023-11-24T06:14:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.035+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f49640d0460 con 0x7f494c003a00 2023-11-24T06:14:19.038 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.036+0000 7f4960ff9700 1 -- 172.21.15.106:0/2649861404 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4958058f60 con 0x7f494c003a00 2023-11-24T06:14:19.038 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:19.040 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.037+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 msgr2=0x7f495006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.037+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 0x7f495006d3c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4954001820 tx=0x7f4954001450 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.037+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 msgr2=0x7f49640cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.037+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4958007fd0 tx=0x7f4958004860 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 shutdown_connections 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f495006af00 0x7f495006d3c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f49640b57f0 0x7f49640cddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f494c003a00 0x7f49640cf720 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 --2- 172.21.15.106:0/2649861404 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f49641f37d0 0x7f49640b52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 >> 172.21.15.106:0/2649861404 conn(0x7f4964071a70 msgr2=0x7f4964146800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 shutdown_connections 2023-11-24T06:14:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.038+0000 7f496a880700 1 -- 172.21.15.106:0/2649861404 wait complete. 2023-11-24T06:14:19.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:19.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.173+0000 7f620eb18700 1 Processor -- start 2023-11-24T06:14:19.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.173+0000 7f620eb18700 1 -- start start 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620eb18700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f620806c710 0x7f62080b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620eb18700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f62080afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620eb18700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62080ae430 con 0x7f620815e080 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620eb18700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62080af0b0 con 0x7f620806c710 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620eb18700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62080b05a0 con 0x7f62080af4d0 2023-11-24T06:14:19.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620c8b4700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f620815e080 0x7f620806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39340/0 (socket says 172.21.15.106:39340) 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f620c8b4700 1 -- 172.21.15.106:0/1395603108 learned_addr learned my addr 172.21.15.106:0/1395603108 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182510159 0 0) 0x7f62080ae430 con 0x7f620815e080 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f6207fff700 1 --2- 172.21.15.106:0/1395603108 >> v2:172.21.15.176:3300/0 conn(0x7f620806c710 0x7f62080b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61f80035b0 con 0x7f620815e080 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273866438 0 0) 0x7f61f80035b0 con 0x7f620815e080 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 msgr2=0x7f62080afb90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f62080afb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 >> v2:172.21.15.176:3300/0 conn(0x7f620806c710 msgr2=0x7f62080b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 --2- 172.21.15.106:0/1395603108 >> v2:172.21.15.176:3300/0 conn(0x7f620806c710 0x7f62080b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62080ae710 con 0x7f620815e080 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f61fc001670 con 0x7f620815e080 2023-11-24T06:14:19.180 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 >> v1:172.21.15.106:6789/0 conn(0x7f620815e080 legacy=0x7f620806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f8003a00 0x7f61f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f61f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f8004d90 0x7f61f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080af0b0 con 0x7f61f8004d90 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080b05a0 con 0x7f61f8003a00 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.174+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f800bb40 con 0x7f62080af4d0 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f8004d90 0x7f61f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f6207fff700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f61f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 -- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 msgr2=0x7f61f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f61f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.181 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 -- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f8003a00 msgr2=0x7f61f8003e20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f61f8003a00 0x7f61f8003e20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 -- 172.21.15.106:0/1395603108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80035b0 con 0x7f61f8004d90 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f6207fff700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f62080af4d0 0x7f61f8004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f620d0b5700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f8004d90 0x7f61f8005210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6200009e60 tx=0x7f61f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c56f7e849ffbbacf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62000098d0 con 0x7f61f8004d90 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620000bac0 con 0x7f61f8004d90 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.175+0000 7f62077fe700 1 -- 172.21.15.106:0/1395603108 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620000be70 con 0x7f61f8004d90 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 -- 172.21.15.106:0/1395603108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f8004d90 msgr2=0x7f61f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 --2- 172.21.15.106:0/1395603108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61f8004d90 0x7f61f8005210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6200009e60 tx=0x7f61f8005880 comp rx=0 tx=0).stop 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620d0b5700 1 -- 172.21.15.106:0/1395603108 reap_dead start 2023-11-24T06:14:19.182 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 -- 172.21.15.106:0/1395603108 shutdown_connections 2023-11-24T06:14:19.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 -- 172.21.15.106:0/1395603108 >> 172.21.15.106:0/1395603108 conn(0x7f6208071b90 msgr2=0x7f6208071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 -- 172.21.15.106:0/1395603108 shutdown_connections 2023-11-24T06:14:19.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.176+0000 7f620eb18700 1 -- 172.21.15.106:0/1395603108 wait complete. 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.177+0000 7f620eb18700 1 Processor -- start 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.177+0000 7f620eb18700 1 -- start start 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f8004d90 0x7f6208142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6208142030 0x7f62080cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62080d0020 con 0x7f6208141bb0 2023-11-24T06:14:19.185 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6208142bf0 con 0x7f6208142030 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620eb18700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6208156a00 con 0x7f61f8004d90 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59092/0 (socket says 172.21.15.106:59092) 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 -- 172.21.15.106:0/593310774 learned_addr learned my addr 172.21.15.106:0/593310774 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f620c8b4700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f8004d90 0x7f6208142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 -- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f8004d90 msgr2=0x7f6208142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f8004d90 0x7f6208142550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 -- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6208142030 msgr2=0x7f62080cfae0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6208142030 0x7f62080cfae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 -- 172.21.15.106:0/593310774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6208161000 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f6207fff700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f61f40118d0 tx=0x7f61f4011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.178+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4004220 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.179+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4004380 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.179+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f40036a0 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.179+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62081612e0 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.179+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62081565f0 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.179+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62080753f0 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.180+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f61f4003800 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.180+0000 7f62057fa700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 0x7f61ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.180+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61f4089950 con 0x7f6208141bb0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.180+0000 7f620c8b4700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 0x7f61ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.181+0000 7f620c8b4700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 0x7f61ec06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61fc004bd0 tx=0x7f61fc001a00 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.185+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f61f4054a00 con 0x7f6208141bb0 2023-11-24T06:14:19.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.389+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6208067f60 con 0x7f6208141bb0 2023-11-24T06:14:19.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.389+0000 7f62057fa700 1 -- 172.21.15.106:0/593310774 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f61f4022080 con 0x7f6208141bb0 2023-11-24T06:14:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 msgr2=0x7f61ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 0x7f61ec06d390 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61fc004bd0 tx=0x7f61fc001a00 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 msgr2=0x7f62080cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f61f40118d0 tx=0x7f61f4011be0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 shutdown_connections 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f61ec06aed0 0x7f61ec06d390 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6208142030 0x7f62080cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f61f8004d90 0x7f6208142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 --2- 172.21.15.106:0/593310774 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6208141bb0 0x7f62080cf5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 >> 172.21.15.106:0/593310774 conn(0x7f6208071b90 msgr2=0x7f620806f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 shutdown_connections 2023-11-24T06:14:19.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.391+0000 7f620eb18700 1 -- 172.21.15.106:0/593310774 wait complete. 2023-11-24T06:14:19.396 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:19.406 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-11-24T06:14:19.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:19.406 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-11-24T06:14:19.443 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:14:19.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:19.443 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-11-24T06:14:19.500 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:19.501 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:19.523 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:19.524 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:19.583 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:19.583 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:19.644 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:19.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 Processor -- start 2023-11-24T06:14:19.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 -- start start 2023-11-24T06:14:19.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f97d015e080 0x7f97d00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00ae430 con 0x7f97d006c710 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d00ae710 con 0x7f97d00af4d0 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.761+0000 7f97d6b48700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d00af0b0 con 0x7f97d015e080 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97d50e5700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f97d006c710 0x7f97d006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39364/0 (socket says 172.21.15.106:39364) 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97d50e5700 1 -- 172.21.15.106:0/2745525810 learned_addr learned my addr 172.21.15.106:0/2745525810 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:19.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97d48e4700 1 --2- 172.21.15.106:0/2745525810 >> v2:172.21.15.176:3300/0 conn(0x7f97d015e080 0x7f97d00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1424230487 0 0) 0x7f97d00ae430 con 0x7f97d006c710 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97c00035b0 con 0x7f97d006c710 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878633257 0 0) 0x7f97d00ae710 con 0x7f97d00af4d0 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d00ae430 con 0x7f97d00af4d0 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199999182 0 0) 0x7f97c00035b0 con 0x7f97d006c710 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 >> v2:172.21.15.176:3300/0 conn(0x7f97d015e080 msgr2=0x7f97d00b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.771 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 --2- 172.21.15.106:0/2745525810 >> v2:172.21.15.176:3300/0 conn(0x7f97d015e080 0x7f97d00b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 >> v1:172.21.15.176:6789/0 conn(0x7f97d00af4d0 legacy=0x7f97d006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00ae9f0 con 0x7f97d006c710 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f97c80019f0 con 0x7f97d006c710 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 >> v1:172.21.15.106:6789/0 conn(0x7f97d006c710 legacy=0x7f97d006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c0003b90 0x7f97c0003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97c0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.772 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0005210 0x7f97c000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00af0b0 con 0x7f97c0004850 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c000c090 con 0x7f97c0003b90 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97c000c250 con 0x7f97c0005210 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97cffff700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97c0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.762+0000 7f97d48e4700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c0003b90 0x7f97c0003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d50e5700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0005210 0x7f97c000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 -- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0005210 msgr2=0x7f97c000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0005210 0x7f97c000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 -- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c0003b90 msgr2=0x7f97c0003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97c0003b90 0x7f97c0003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 -- 172.21.15.106:0/2745525810 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c00035b0 con 0x7f97c0004850 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d50e5700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97c0005210 0x7f97c000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d50e5700 1 -- 172.21.15.106:0/2745525810 reap_dead start 2023-11-24T06:14:19.774 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cffff700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97c0004cd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f97d00af950 tx=0x7f97c0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b804313358fd43 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc001430 con 0x7f97c0004850 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97bc0052f0 con 0x7f97c0004850 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97cf7fe700 1 -- 172.21.15.106:0/2745525810 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97bc001d40 con 0x7f97c0004850 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d6b48700 1 -- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 msgr2=0x7f97c0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d6b48700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97c0004cd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f97d00af950 tx=0x7f97c0005880 comp rx=0 tx=0).stop 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d6b48700 1 -- 172.21.15.106:0/2745525810 shutdown_connections 2023-11-24T06:14:19.775 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d6b48700 1 --2- 172.21.15.106:0/2745525810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97c0004cd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.763+0000 7f97d6b48700 1 -- 172.21.15.106:0/2745525810 >> 172.21.15.106:0/2745525810 conn(0x7f97d0071b90 msgr2=0x7f97d0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.764+0000 7f97d6b48700 1 -- 172.21.15.106:0/2745525810 shutdown_connections 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.764+0000 7f97d6b48700 1 -- 172.21.15.106:0/2745525810 wait complete. 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.765+0000 7f97d6b48700 1 Processor -- start 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.765+0000 7f97d6b48700 1 -- start start 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 0x7f97d0142050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d01569d0 0x7f97d0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00cf8d0 con 0x7f97c0004850 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00cec50 con 0x7f97d00cfcf0 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d00cef30 con 0x7f97d01569d0 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59110/0 (socket says 172.21.15.106:59110) 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 -- 172.21.15.106:0/3755130579 learned_addr learned my addr 172.21.15.106:0/3755130579 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d50e5700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d01569d0 0x7f97d0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97cffff700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 0x7f97d0142050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 -- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d01569d0 msgr2=0x7f97d0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d01569d0 0x7f97d0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 -- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 msgr2=0x7f97d0142050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 0x7f97d0142050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 -- 172.21.15.106:0/3755130579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d00cf210 con 0x7f97c0004850 2023-11-24T06:14:19.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97cffff700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 0x7f97d0142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d48e4700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f97c4011aa0 tx=0x7f97c4011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c400f9e0 con 0x7f97c0004850 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c400fb40 con 0x7f97c0004850 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d00cf4f0 con 0x7f97c0004850 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4014440 con 0x7f97c0004850 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.766+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d0157030 con 0x7f97c0004850 2023-11-24T06:14:19.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.767+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d00753f0 con 0x7f97c0004850 2023-11-24T06:14:19.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.768+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f97c40145a0 con 0x7f97c0004850 2023-11-24T06:14:19.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.768+0000 7f97cd7fa700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 0x7f97b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:19.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.768+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f97c4089ca0 con 0x7f97c0004850 2023-11-24T06:14:19.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.768+0000 7f97cffff700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 0x7f97b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:19.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.768+0000 7f97cffff700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 0x7f97b406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f97d0061e30 tx=0x7f97bc00a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:19.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.772+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97c4054de0 con 0x7f97c0004850 2023-11-24T06:14:19.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.963+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97d00d0110 con 0x7f97c0004850 2023-11-24T06:14:19.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.964+0000 7f97cd7fa700 1 -- 172.21.15.106:0/3755130579 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16529 (secure 0 0 0) 0x7f97c4058400 con 0x7f97c0004850 2023-11-24T06:14:19.967 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:19.967 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:13:42.927998+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 msgr2=0x7f97b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 0x7f97b406d390 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f97d0061e30 tx=0x7f97bc00a000 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 msgr2=0x7f97d00ce670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f97c4011aa0 tx=0x7f97c4011e60 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 shutdown_connections 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f97b406aed0 0x7f97b406d390 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f97d01569d0 0x7f97d0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97c0004850 0x7f97d00ce670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 --2- 172.21.15.106:0/3755130579 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f97d00cfcf0 0x7f97d0142050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 >> 172.21.15.106:0/3755130579 conn(0x7f97d0071b90 msgr2=0x7f97d006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:19.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 shutdown_connections 2023-11-24T06:14:19.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:19.966+0000 7f97d6b48700 1 -- 172.21.15.106:0/3755130579 wait complete. 2023-11-24T06:14:19.981 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:19.981 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:20.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.101+0000 7f203eda6700 1 Processor -- start 2023-11-24T06:14:20.104 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.101+0000 7f203eda6700 1 -- start start 2023-11-24T06:14:20.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203eda6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203eda6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20380ad870 0x7f203806f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203eda6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f203806e400 con 0x7f203815e290 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203eda6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f203806e630 con 0x7f20380ad870 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203eda6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f203806e910 con 0x7f20380aedc0 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20380ad870 0x7f203806f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f20380ad870 0x7f203806f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59122/0 (socket says 172.21.15.106:59122) 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 -- 172.21.15.106:0/3083596771 learned_addr learned my addr 172.21.15.106:0/3083596771 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 -- 172.21.15.106:0/3083596771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 msgr2=0x7f20380ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 --2- 172.21.15.106:0/3083596771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.107 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.102+0000 7f203d343700 1 -- 172.21.15.106:0/3083596771 >> v1:172.21.15.176:6789/0 conn(0x7f203815e290 legacy=0x7f20380af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203d343700 1 -- 172.21.15.106:0/3083596771 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f203806ebf0 con 0x7f20380ad870 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203d343700 1 --2- 172.21.15.106:0/3083596771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380ad870 0x7f203806f6d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2030009e50 tx=0x7f203000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6822dc98f0f7c24a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f20377fe700 1 -- 172.21.15.106:0/3083596771 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203000e070 con 0x7f20380ad870 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f20377fe700 1 -- 172.21.15.106:0/3083596771 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030003a20 con 0x7f20380ad870 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f20377fe700 1 -- 172.21.15.106:0/3083596771 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2030003dd0 con 0x7f20380ad870 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 -- 172.21.15.106:0/3083596771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380ad870 msgr2=0x7f203806f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 --2- 172.21.15.106:0/3083596771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380ad870 0x7f203806f6d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f2030009e50 tx=0x7f203000b330 comp rx=0 tx=0).stop 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 -- 172.21.15.106:0/3083596771 shutdown_connections 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 --2- 172.21.15.106:0/3083596771 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 --2- 172.21.15.106:0/3083596771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f20380ad870 0x7f203806f6d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 -- 172.21.15.106:0/3083596771 >> 172.21.15.106:0/3083596771 conn(0x7f20380b2050 msgr2=0x7f20380b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.108 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 -- 172.21.15.106:0/3083596771 shutdown_connections 2023-11-24T06:14:20.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.103+0000 7f203eda6700 1 -- 172.21.15.106:0/3083596771 wait complete. 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.105+0000 7f203eda6700 1 Processor -- start 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.105+0000 7f203eda6700 1 -- start start 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20380ad870 0x7f20381577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f203813e860 con 0x7f203815e290 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cced0 con 0x7f20380ad870 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203eda6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20380cd1b0 con 0x7f20380aedc0 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59128/0 (socket says 172.21.15.106:59128) 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 -- 172.21.15.106:0/2490669680 learned_addr learned my addr 172.21.15.106:0/2490669680 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203cb42700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20380ad870 0x7f20381577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f2037fff700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 -- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 msgr2=0x7f20380b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 -- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20380ad870 msgr2=0x7f20381577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20380ad870 0x7f20381577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.112 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.106+0000 7f203d343700 1 -- 172.21.15.106:0/2490669680 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2030009b30 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f203d343700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2030004000 tx=0x7f2030004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300094d0 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2030004240 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20380b3d50 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20300045f0 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.107+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f203814abf0 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.108+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2038068d90 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.108+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2030019070 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.108+0000 7f20357fa700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 0x7f201c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.109+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f203008a440 con 0x7f203815e290 2023-11-24T06:14:20.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.109+0000 7f203cb42700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 0x7f201c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.114 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.109+0000 7f203cb42700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 0x7f201c06d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f203814b420 tx=0x7f202c009190 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.115 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.113+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2030055580 con 0x7f203815e290 2023-11-24T06:14:20.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.305+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20380ae600 con 0x7f203815e290 2023-11-24T06:14:20.308 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.305+0000 7f20357fa700 1 -- 172.21.15.106:0/2490669680 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2030020020 con 0x7f203815e290 2023-11-24T06:14:20.308 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:20.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 msgr2=0x7f201c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 0x7f201c06d390 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f203814b420 tx=0x7f202c009190 comp rx=0 tx=0).stop 2023-11-24T06:14:20.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 msgr2=0x7f20380b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.310 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2030004000 tx=0x7f2030004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 shutdown_connections 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f201c06aed0 0x7f201c06d390 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f203815e290 0x7f20380b4270 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f20380ad870 0x7f20381577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 --2- 172.21.15.106:0/2490669680 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f20380aedc0 0x7f20380b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 >> 172.21.15.106:0/2490669680 conn(0x7f20380b2050 msgr2=0x7f203815d100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 shutdown_connections 2023-11-24T06:14:20.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.307+0000 7f203eda6700 1 -- 172.21.15.106:0/2490669680 wait complete. 2023-11-24T06:14:20.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:20.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.443+0000 7fb03427f700 1 Processor -- start 2023-11-24T06:14:20.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.443+0000 7fb03427f700 1 -- start start 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03427f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb02c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03427f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0d0140 con 0x7fb02c0c6c30 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03427f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02c0cf3c0 con 0x7fb02c0ce830 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03427f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15c330 con 0x7fb02c15bf50 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03281c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb02c0c6c30 0x7fb02c0cc6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39398/0 (socket says 172.21.15.106:39398) 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03281c700 1 -- 172.21.15.106:0/4176744957 learned_addr learned my addr 172.21.15.106:0/4176744957 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822859481 0 0) 0x7fb02c0d0140 con 0x7fb02c0c6c30 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0180035b0 con 0x7fb02c0c6c30 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb03201b700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb02c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.450 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2811918584 0 0) 0x7fb0180035b0 con 0x7fb02c0c6c30 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 msgr2=0x7fb02c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb02c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 >> v1:172.21.15.176:6789/0 conn(0x7fb02c0ce830 legacy=0x7fb02c0cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0d03e0 con 0x7fb02c0c6c30 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb0240019f0 con 0x7fb02c0c6c30 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 >> v1:172.21.15.106:6789/0 conn(0x7fb02c0c6c30 legacy=0x7fb02c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb018003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb018004090 0x7fb018004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb018004d90 0x7fb018005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.451 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c15c330 con 0x7fb018004090 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01800bc00 con 0x7fb018004d90 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.444+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01800bdc0 con 0x7fb02c15bf50 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb018004090 0x7fb018004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03201b700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb018003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03281c700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb018004d90 0x7fb018005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 -- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 msgr2=0x7fb018003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb02c15bf50 0x7fb018003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 -- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb018004d90 msgr2=0x7fb018005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb018004d90 0x7fb018005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.452 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 -- 172.21.15.106:0/4176744957 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180035b0 con 0x7fb018004090 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb03181a700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb018004090 0x7fb018004850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb01c003eb0 tx=0x7fb018005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aba6a0e1e29775b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c016070 con 0x7fb018004090 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c006860 con 0x7fb018004090 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.445+0000 7fb031019700 1 -- 172.21.15.106:0/4176744957 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c003950 con 0x7fb018004090 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 -- 172.21.15.106:0/4176744957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb018004090 msgr2=0x7fb018004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 --2- 172.21.15.106:0/4176744957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb018004090 0x7fb018004850 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb01c003eb0 tx=0x7fb018005880 comp rx=0 tx=0).stop 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03281c700 1 -- 172.21.15.106:0/4176744957 reap_dead start 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 -- 172.21.15.106:0/4176744957 shutdown_connections 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 -- 172.21.15.106:0/4176744957 >> 172.21.15.106:0/4176744957 conn(0x7fb02c0b3780 msgr2=0x7fb02c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.453 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 -- 172.21.15.106:0/4176744957 shutdown_connections 2023-11-24T06:14:20.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.446+0000 7fb03427f700 1 -- 172.21.15.106:0/4176744957 wait complete. 2023-11-24T06:14:20.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.447+0000 7fb03427f700 1 Processor -- start 2023-11-24T06:14:20.454 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.447+0000 7fb03427f700 1 -- start start 2023-11-24T06:14:20.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb018004090 0x7fb02c0c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.456 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 0x7fb02c1f0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0c91c0 con 0x7fb02c154010 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c1548b0 con 0x7fb02c1f4090 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c0b71b0 con 0x7fb018004090 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59146/0 (socket says 172.21.15.106:59146) 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 -- 172.21.15.106:0/2014433967 learned_addr learned my addr 172.21.15.106:0/2014433967 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03201b700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb018004090 0x7fb02c0c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03281c700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 0x7fb02c1f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.457 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 -- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb018004090 msgr2=0x7fb02c0c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb018004090 0x7fb02c0c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 -- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 msgr2=0x7fb02c1f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 0x7fb02c1f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 -- 172.21.15.106:0/2014433967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02c0b7490 con 0x7fb02c154010 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03281c700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 0x7fb02c1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03181a700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0044a0 tx=0x7fb01c003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c016040 con 0x7fb02c154010 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01c007530 con 0x7fb02c154010 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c0b7770 con 0x7fb02c154010 2023-11-24T06:14:20.458 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01c025460 con 0x7fb02c154010 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.448+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c1f3840 con 0x7fb02c154010 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.449+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c1f39d0 con 0x7fb02c154010 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.450+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb01c01c420 con 0x7fb02c154010 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.450+0000 7fb022ffd700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 0x7fb01006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.450+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb01c08a600 con 0x7fb02c154010 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.450+0000 7fb03201b700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 0x7fb01006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.450+0000 7fb03201b700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 0x7fb01006d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb028009950 tx=0x7fb028008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.459 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.454+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb02c1f39d0 con 0x7fb02c154010 2023-11-24T06:14:20.646 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.644+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb02c1f39d0 con 0x7fb02c154010 2023-11-24T06:14:20.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.644+0000 7fb022ffd700 1 -- 172.21.15.106:0/2014433967 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb02c1f39d0 con 0x7fb02c154010 2023-11-24T06:14:20.647 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:20.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 msgr2=0x7fb01006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 0x7fb01006d390 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb028009950 tx=0x7fb028008040 comp rx=0 tx=0).stop 2023-11-24T06:14:20.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 msgr2=0x7fb02c0b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0044a0 tx=0x7fb01c003780 comp rx=0 tx=0).stop 2023-11-24T06:14:20.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 shutdown_connections 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb01006aed0 0x7fb01006d390 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb02c1f4090 0x7fb02c1f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb018004090 0x7fb02c0c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 --2- 172.21.15.106:0/2014433967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb02c154010 0x7fb02c0b6670 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 >> 172.21.15.106:0/2014433967 conn(0x7fb02c0b3780 msgr2=0x7fb02c15b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 shutdown_connections 2023-11-24T06:14:20.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.646+0000 7fb03427f700 1 -- 172.21.15.106:0/2014433967 wait complete. 2023-11-24T06:14:20.661 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:20.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.782+0000 7feda9068700 1 Processor -- start 2023-11-24T06:14:20.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.782+0000 7feda9068700 1 -- start start 2023-11-24T06:14:20.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda9068700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 0x7feda40ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda9068700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feda40ad870 0x7feda406f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda9068700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feda406e400 con 0x7feda415e290 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda9068700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda406e630 con 0x7feda40ad870 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda9068700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feda406e910 con 0x7feda40aedc0 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feda40ad870 0x7feda406f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feda40ad870 0x7feda406f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59156/0 (socket says 172.21.15.106:59156) 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 -- 172.21.15.106:0/1227729672 learned_addr learned my addr 172.21.15.106:0/1227729672 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1227729672 >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 0x7feda40ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 -- 172.21.15.106:0/1227729672 >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 msgr2=0x7feda40ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 --2- 172.21.15.106:0/1227729672 >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 0x7feda40ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 -- 172.21.15.106:0/1227729672 >> v1:172.21.15.176:6789/0 conn(0x7feda415e290 legacy=0x7feda40af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:20.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 -- 172.21.15.106:0/1227729672 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feda406ebf0 con 0x7feda40ad870 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1227729672 >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 0x7feda40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.783+0000 7feda359e700 1 --2- 172.21.15.106:0/1227729672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40ad870 0x7feda406f6d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feda4072800 tx=0x7fed9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89408311afe3baf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda1d9b700 1 -- 172.21.15.106:0/1227729672 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c00e070 con 0x7feda40ad870 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda1d9b700 1 -- 172.21.15.106:0/1227729672 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed9c003a20 con 0x7feda40ad870 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda1d9b700 1 -- 172.21.15.106:0/1227729672 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9c003dd0 con 0x7feda40ad870 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 -- 172.21.15.106:0/1227729672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40ad870 msgr2=0x7feda406f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 --2- 172.21.15.106:0/1227729672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40ad870 0x7feda406f6d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feda4072800 tx=0x7fed9c00b330 comp rx=0 tx=0).stop 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 -- 172.21.15.106:0/1227729672 shutdown_connections 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 --2- 172.21.15.106:0/1227729672 >> v2:172.21.15.176:3300/0 conn(0x7feda40aedc0 0x7feda40ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 --2- 172.21.15.106:0/1227729672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40ad870 0x7feda406f6d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 -- 172.21.15.106:0/1227729672 >> 172.21.15.106:0/1227729672 conn(0x7feda40b2050 msgr2=0x7feda40b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 -- 172.21.15.106:0/1227729672 shutdown_connections 2023-11-24T06:14:20.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.784+0000 7feda9068700 1 -- 172.21.15.106:0/1227729672 wait complete. 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 Processor -- start 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 -- start start 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 0x7feda414bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feda415e290 0x7feda40b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda4161090 con 0x7feda40aedc0 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda41614b0 con 0x7feda40ad870 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.786+0000 7feda9068700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feda4160410 con 0x7feda415e290 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59160/0 (socket says 172.21.15.106:59160) 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 -- 172.21.15.106:0/1244498064 learned_addr learned my addr 172.21.15.106:0/1244498064 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 0x7feda414bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.969 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda359e700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feda415e290 0x7feda40b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 -- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feda415e290 msgr2=0x7feda40b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feda415e290 0x7feda40b0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 -- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 msgr2=0x7feda414bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 0x7feda414bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 -- 172.21.15.106:0/1244498064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c009b30 con 0x7feda40aedc0 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 0x7feda414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda259c700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fed9400b4d0 tx=0x7fed9400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94011830 con 0x7feda40aedc0 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed94011990 con 0x7feda40aedc0 2023-11-24T06:14:20.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda41606f0 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94011d40 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.787+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda4160cb0 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.788+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feda4068d90 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.788+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fed9401a400 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.789+0000 7fed8b7fe700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 0x7fed9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.789+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed94089260 con 0x7feda40aedc0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.789+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 0x7fed9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.789+0000 7feda2d9d700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 0x7fed9006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed98006fd0 tx=0x7fed98008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:20.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.793+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fed940543a0 con 0x7feda40aedc0 2023-11-24T06:14:20.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.985+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feda41611d0 con 0x7feda40aedc0 2023-11-24T06:14:20.987 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.985+0000 7fed8b7fe700 1 -- 172.21.15.106:0/1244498064 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7feda41611d0 con 0x7feda40aedc0 2023-11-24T06:14:20.988 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:20.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 msgr2=0x7fed9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 0x7fed9006d390 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fed98006fd0 tx=0x7fed98008040 comp rx=0 tx=0).stop 2023-11-24T06:14:20.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 msgr2=0x7feda415fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:20.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fed9400b4d0 tx=0x7fed9400b890 comp rx=0 tx=0).stop 2023-11-24T06:14:20.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 shutdown_connections 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed9006aed0 0x7fed9006d390 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7feda415e290 0x7feda40b0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7feda40ad870 0x7feda414bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 --2- 172.21.15.106:0/1244498064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feda40aedc0 0x7feda415fb30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 >> 172.21.15.106:0/1244498064 conn(0x7feda40b2050 msgr2=0x7feda4071320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:20.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 shutdown_connections 2023-11-24T06:14:20.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:20.987+0000 7feda9068700 1 -- 172.21.15.106:0/1244498064 wait complete. 2023-11-24T06:14:21.002 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:21.123 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.120+0000 7f03b12c2700 1 Processor -- start 2023-11-24T06:14:21.124 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03b12c2700 1 -- start start 2023-11-24T06:14:21.127 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03b12c2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f03ac15d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03b12c2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0b1c60 con 0x7f03ac0b1390 2023-11-24T06:14:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03b12c2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03ac0d0450 con 0x7f03ac0b0fb0 2023-11-24T06:14:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03b12c2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0d0720 con 0x7f03ac06be60 2023-11-24T06:14:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03aa7fc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f03ac0b1390 0x7f03ac06b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39428/0 (socket says 172.21.15.106:39428) 2023-11-24T06:14:21.128 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.121+0000 7f03aa7fc700 1 -- 172.21.15.106:0/3939710056 learned_addr learned my addr 172.21.15.106:0/3939710056 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:21.129 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03ab7fe700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f03ac15d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228714933 0 0) 0x7f03ac0b1c60 con 0x7f03ac0b1390 2023-11-24T06:14:21.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03940035b0 con 0x7f03ac0b1390 2023-11-24T06:14:21.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3400767194 0 0) 0x7f03940035b0 con 0x7f03ac0b1390 2023-11-24T06:14:21.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 msgr2=0x7f03ac15d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.130 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f03ac15d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 >> v1:172.21.15.176:6789/0 conn(0x7f03ac0b0fb0 legacy=0x7f03ac0cfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0d0a00 con 0x7f03ac0b1390 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f039c001670 con 0x7f03ac0b1390 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 >> v1:172.21.15.106:6789/0 conn(0x7f03ac0b1390 legacy=0x7f03ac06b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0394003a30 0x7f0394003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f0394005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0d0720 con 0x7f0394004850 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039400bb80 con 0x7f0394003a30 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039400bd40 con 0x7f03ac06be60 2023-11-24T06:14:21.131 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aaffd700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0394003a30 0x7f0394003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03ab7fe700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f0394005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 -- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 msgr2=0x7f0394005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac06be60 0x7f0394005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 -- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0394003a30 msgr2=0x7f0394003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0394003a30 0x7f0394003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.122+0000 7f03aa7fc700 1 -- 172.21.15.106:0/3939710056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940035b0 con 0x7f0394004850 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f039c00c210 tx=0x7f0394005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3a8dc0cb788269 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c007c10 con 0x7f0394004850 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039c00cdb0 con 0x7f0394004850 2023-11-24T06:14:21.132 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03a9ffb700 1 -- 172.21.15.106:0/3939710056 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039c005ba0 con 0x7f0394004850 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 -- 172.21.15.106:0/3939710056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 msgr2=0x7f0394004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 --2- 172.21.15.106:0/3939710056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f0394004cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f039c00c210 tx=0x7f0394005880 comp rx=0 tx=0).stop 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03ab7fe700 1 -- 172.21.15.106:0/3939710056 reap_dead start 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 -- 172.21.15.106:0/3939710056 shutdown_connections 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 -- 172.21.15.106:0/3939710056 >> 172.21.15.106:0/3939710056 conn(0x7f03ac09aa00 msgr2=0x7f03ac09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 -- 172.21.15.106:0/3939710056 shutdown_connections 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.123+0000 7f03b12c2700 1 -- 172.21.15.106:0/3939710056 wait complete. 2023-11-24T06:14:21.133 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 Processor -- start 2023-11-24T06:14:21.134 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 -- start start 2023-11-24T06:14:21.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.136 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ac14fde0 0x7f03ac152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac152b90 0x7f03ac1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac153040 con 0x7f0394004850 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0c8650 con 0x7f03ac14fde0 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.125+0000 7f03b12c2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03ac0b6d10 con 0x7f03ac152b90 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59178/0 (socket says 172.21.15.106:59178) 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 -- 172.21.15.106:0/2044568575 learned_addr learned my addr 172.21.15.106:0/2044568575 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 -- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac152b90 msgr2=0x7f03ac1f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac152b90 0x7f03ac1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 -- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ac14fde0 msgr2=0x7f03ac152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.137 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ac14fde0 0x7f03ac152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 -- 172.21.15.106:0/2044568575 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ac0cbef0 con 0x7f0394004850 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03aaffd700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f03a000f7d0 tx=0x7f03a000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00052e0 con 0x7f0394004850 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a0005440 con 0x7f0394004850 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03ac0b6420 con 0x7f0394004850 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a00038a0 con 0x7f0394004850 2023-11-24T06:14:21.138 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.126+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03ac0b66c0 con 0x7f0394004850 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.127+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03ac068480 con 0x7f0394004850 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.128+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03a0003a00 con 0x7f0394004850 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.128+0000 7f03937fe700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 0x7f039806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.128+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03a00892c0 con 0x7f0394004850 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.128+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 0x7f039806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.128+0000 7f03aa7fc700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 0x7f039806d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03ac156c00 tx=0x7f039c00a000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.139 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.132+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03a0054400 con 0x7f0394004850 2023-11-24T06:14:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.339+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03ac0751e0 con 0x7f0394004850 2023-11-24T06:14:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.339+0000 7f03937fe700 1 -- 172.21.15.106:0/2044568575 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f03a0003cb0 con 0x7f0394004850 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 msgr2=0x7f039806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 0x7f039806d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f03ac156c00 tx=0x7f039c00a000 comp rx=0 tx=0).stop 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 msgr2=0x7f03ac0c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f03a000f7d0 tx=0x7f03a000fb90 comp rx=0 tx=0).stop 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 shutdown_connections 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039806aed0 0x7f039806d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f03ac152b90 0x7f03ac1f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0394004850 0x7f03ac0c8110 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 --2- 172.21.15.106:0/2044568575 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03ac14fde0 0x7f03ac152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 >> 172.21.15.106:0/2044568575 conn(0x7f03ac09aa00 msgr2=0x7f03ac0d1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 shutdown_connections 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.341+0000 7f03b12c2700 1 -- 172.21.15.106:0/2044568575 wait complete. 2023-11-24T06:14:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:21.356 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-11-24T06:14:21.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:21.356 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-11-24T06:14:21.400 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:14:21.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:21.400 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-11-24T06:14:21.459 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-11-24T06:14:21.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 Processor -- start 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 -- start start 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f098015bdd0 0x7f09801604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09800d1c70 0x7f09800d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800b2f50 con 0x7f09800d1c70 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800d2660 con 0x7f098015bdd0 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.577+0000 7f0986968700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09800b2030 con 0x7f09800b3370 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09800d1c70 0x7f09800d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09800d1c70 0x7f09800d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59188/0 (socket says 172.21.15.106:59188) 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 -- 172.21.15.106:0/3621626087 learned_addr learned my addr 172.21.15.106:0/3621626087 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 -- 172.21.15.106:0/3621626087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 msgr2=0x7f09800b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 --2- 172.21.15.106:0/3621626087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 -- 172.21.15.106:0/3621626087 >> v2:172.21.15.176:3300/0 conn(0x7f098015bdd0 msgr2=0x7f09801604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 --2- 172.21.15.106:0/3621626087 >> v2:172.21.15.176:3300/0 conn(0x7f098015bdd0 0x7f09801604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 -- 172.21.15.106:0/3621626087 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800b22d0 con 0x7f09800d1c70 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f0984f05700 1 --2- 172.21.15.106:0/3621626087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800d2120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f098006ec10 tx=0x7f097800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802c084894f9cd79 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f097effd700 1 -- 172.21.15.106:0/3621626087 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800e070 con 0x7f09800d1c70 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f097effd700 1 -- 172.21.15.106:0/3621626087 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800b9c0 con 0x7f09800d1c70 2023-11-24T06:14:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.578+0000 7f097effd700 1 -- 172.21.15.106:0/3621626087 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097800bd70 con 0x7f09800d1c70 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 -- 172.21.15.106:0/3621626087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 msgr2=0x7f09800d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 --2- 172.21.15.106:0/3621626087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800d2120 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f098006ec10 tx=0x7f097800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 -- 172.21.15.106:0/3621626087 shutdown_connections 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 --2- 172.21.15.106:0/3621626087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800d2120 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 --2- 172.21.15.106:0/3621626087 >> v2:172.21.15.176:3300/0 conn(0x7f098015bdd0 0x7f09801604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 --2- 172.21.15.106:0/3621626087 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 -- 172.21.15.106:0/3621626087 >> 172.21.15.106:0/3621626087 conn(0x7f09800731a0 msgr2=0x7f098009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 -- 172.21.15.106:0/3621626087 shutdown_connections 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.579+0000 7f0986968700 1 -- 172.21.15.106:0/3621626087 wait complete. 2023-11-24T06:14:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.580+0000 7f0986968700 1 Processor -- start 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.580+0000 7f0986968700 1 -- start start 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 0x7f09800c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09801577d0 con 0x7f09800d1c70 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09800cc680 con 0x7f098015bdd0 2023-11-24T06:14:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0986968700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098006b480 con 0x7f09800b3370 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59192/0 (socket says 172.21.15.106:59192) 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 -- 172.21.15.106:0/2154983972 learned_addr learned my addr 172.21.15.106:0/2154983972 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0984f05700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 0x7f09800c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097ffff700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 -- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 msgr2=0x7f09800c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 -- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 msgr2=0x7f09800c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 0x7f09800c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097f7fe700 1 -- 172.21.15.106:0/2154983972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978009b30 con 0x7f09800d1c70 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f0984f05700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 0x7f09800c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.581+0000 7f097ffff700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f097f7fe700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f097400b4a0 tx=0x7f097400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011830 con 0x7f09800d1c70 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0974011990 con 0x7f09800d1c70 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098006b760 con 0x7f09800d1c70 2023-11-24T06:14:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974011d40 con 0x7f09800d1c70 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.582+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098006bd20 con 0x7f09800d1c70 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.583+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09800cc960 con 0x7f09800d1c70 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.583+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f097401a400 con 0x7f09800d1c70 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.584+0000 7f097cff9700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 0x7f096c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.584+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09740895b0 con 0x7f09800d1c70 2023-11-24T06:14:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.584+0000 7f097ffff700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 0x7f096c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.584+0000 7f097ffff700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 0x7f096c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0970007900 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.588+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0974054670 con 0x7f09800d1c70 2023-11-24T06:14:21.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.824+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0980067f60 con 0x7f09800d1c70 2023-11-24T06:14:21.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.824+0000 7f097cff9700 1 -- 172.21.15.106:0/2154983972 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f0974057c90 con 0x7f09800d1c70 2023-11-24T06:14:21.827 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:21.828 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:14:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 msgr2=0x7f096c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 0x7f096c06d390 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0970007900 tx=0x7f0970008040 comp rx=0 tx=0).stop 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 msgr2=0x7f09800c4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f097400b4a0 tx=0x7f097400b860 comp rx=0 tx=0).stop 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 shutdown_connections 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f096c06aed0 0x7f096c06d390 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f098015bdd0 0x7f09800c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09800b3370 0x7f09800c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 --2- 172.21.15.106:0/2154983972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09800d1c70 0x7f09800c4750 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 >> 172.21.15.106:0/2154983972 conn(0x7f09800731a0 msgr2=0x7f09800cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 shutdown_connections 2023-11-24T06:14:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.826+0000 7f0986968700 1 -- 172.21.15.106:0/2154983972 wait complete. 2023-11-24T06:14:21.831 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:14:21.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.960+0000 7fcf07146700 1 Processor -- start 2023-11-24T06:14:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.960+0000 7fcf07146700 1 -- start start 2023-11-24T06:14:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf07146700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf000b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf07146700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf0006c710 0x7fcf000afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf07146700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf000ae430 con 0x7fcf000af4d0 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf07146700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf000af0b0 con 0x7fcf0006c710 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf07146700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf000b05a0 con 0x7fcf0015e080 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf0006c710 0x7fcf000afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf0006c710 0x7fcf000afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59202/0 (socket says 172.21.15.106:59202) 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 -- 172.21.15.106:0/764517368 learned_addr learned my addr 172.21.15.106:0/764517368 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf04ee2700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf000b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 -- 172.21.15.106:0/764517368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 msgr2=0x7fcf000b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf000b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.961+0000 7fcf056e3700 1 -- 172.21.15.106:0/764517368 >> v1:172.21.15.176:6789/0 conn(0x7fcf000af4d0 legacy=0x7fcf0006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf056e3700 1 -- 172.21.15.106:0/764517368 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf000ae710 con 0x7fcf0006c710 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf056e3700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf000afb90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e80 tx=0x7fcef800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e7af18d79270562 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fceff7fe700 1 -- 172.21.15.106:0/764517368 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800e070 con 0x7fcf0006c710 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fceff7fe700 1 -- 172.21.15.106:0/764517368 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef800b980 con 0x7fcf0006c710 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fceff7fe700 1 -- 172.21.15.106:0/764517368 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef800bd30 con 0x7fcf0006c710 2023-11-24T06:14:21.967 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 -- 172.21.15.106:0/764517368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 msgr2=0x7fcf000afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf000afb90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e80 tx=0x7fcef800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 -- 172.21.15.106:0/764517368 shutdown_connections 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf000b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 --2- 172.21.15.106:0/764517368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf000afb90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 -- 172.21.15.106:0/764517368 >> 172.21.15.106:0/764517368 conn(0x7fcf00071b90 msgr2=0x7fcf00071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 -- 172.21.15.106:0/764517368 shutdown_connections 2023-11-24T06:14:21.968 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.962+0000 7fcf07146700 1 -- 172.21.15.106:0/764517368 wait complete. 2023-11-24T06:14:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.964+0000 7fcf07146700 1 Processor -- start 2023-11-24T06:14:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.964+0000 7fcf07146700 1 -- start start 2023-11-24T06:14:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.964+0000 7fcf07146700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.964+0000 7fcf07146700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 0x7fcf00154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.964+0000 7fcf07146700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf00156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf07146700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00158290 con 0x7fcf0006c710 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf07146700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00153b60 con 0x7fcf000af4d0 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf07146700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf00157610 con 0x7fcf0015e080 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59204/0 (socket says 172.21.15.106:59204) 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 -- 172.21.15.106:0/1417614395 learned_addr learned my addr 172.21.15.106:0/1417614395 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcefffff700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 0x7fcf00154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf056e3700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf00156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 -- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 msgr2=0x7fcf00156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf00156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 -- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 msgr2=0x7fcf00154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 0x7fcf00154090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 -- 172.21.15.106:0/1417614395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009b30 con 0x7fcf0006c710 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcefffff700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 0x7fcf00154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf04ee2700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d800 tx=0x7fcef400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef40125f0 con 0x7fcf0006c710 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef4012750 con 0x7fcf0006c710 2023-11-24T06:14:21.973 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf001578f0 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef4012b00 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.965+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf00157eb0 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.966+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf000753f0 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.967+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcef4012c60 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.967+0000 7fcefd7fa700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 0x7fcee406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.967+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcef40899d0 con 0x7fcf0006c710 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.967+0000 7fcefffff700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 0x7fcee406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:21.974 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.968+0000 7fcefffff700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 0x7fcee406d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf000c6260 tx=0x7fceec009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:21.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:21.972+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcef4054a80 con 0x7fcf0006c710 2023-11-24T06:14:22.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.162+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf00067f60 con 0x7fcf0006c710 2023-11-24T06:14:22.172 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.169+0000 7fcefd7fa700 1 -- 172.21.15.106:0/1417614395 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16779 (secure 0 0 0) 0x7fcef40580a0 con 0x7fcf0006c710 2023-11-24T06:14:22.172 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:22.173 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":21,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:22.157549+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:22.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 msgr2=0x7fcee406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 0x7fcee406d390 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fcf000c6260 tx=0x7fceec009040 comp rx=0 tx=0).stop 2023-11-24T06:14:22.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 msgr2=0x7fcf00153620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fcef400d800 tx=0x7fcef400dbc0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 shutdown_connections 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcee406aed0 0x7fcee406d390 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcf0015e080 0x7fcf00156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf0006c710 0x7fcf00153620 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 --2- 172.21.15.106:0/1417614395 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcf000af4d0 0x7fcf00154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.175 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 >> 172.21.15.106:0/1417614395 conn(0x7fcf00071b90 msgr2=0x7fcf0006bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 shutdown_connections 2023-11-24T06:14:22.176 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.172+0000 7fcf07146700 1 -- 172.21.15.106:0/1417614395 wait complete. 2023-11-24T06:14:22.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:13:39.020185+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:13:40.278324+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:22.188 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:22.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.308+0000 7f55f4851700 1 Processor -- start 2023-11-24T06:14:22.311 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.308+0000 7f55f4851700 1 -- start start 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55f4851700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f55f015bf50 0x7f55f00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55f4851700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55f00c6c30 0x7f55f00cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55f4851700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00d0140 con 0x7f55f00ce830 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55f4851700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f015c330 con 0x7f55f00c6c30 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55f4851700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00cf3c0 con 0x7f55f015bf50 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55f00c6c30 0x7f55f00cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55edd9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f55f00ce830 0x7f55f00cecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39476/0 (socket says 172.21.15.106:39476) 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55edd9b700 1 -- 172.21.15.106:0/1800141892 learned_addr learned my addr 172.21.15.106:0/1800141892 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 -- 172.21.15.106:0/1800141892 >> v2:172.21.15.176:3300/0 conn(0x7f55f015bf50 msgr2=0x7f55f00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:22.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 --2- 172.21.15.106:0/1800141892 >> v2:172.21.15.176:3300/0 conn(0x7f55f015bf50 0x7f55f00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 -- 172.21.15.106:0/1800141892 >> v1:172.21.15.106:6789/0 conn(0x7f55f00ce830 legacy=0x7f55f00cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 -- 172.21.15.106:0/1800141892 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00d03e0 con 0x7f55f00c6c30 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55ed59a700 1 -- 172.21.15.106:0/1800141892 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599729945 0 0) 0x7f55f00d0140 con 0x7f55f00ce830 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.309+0000 7f55eed9d700 1 --2- 172.21.15.106:0/1800141892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f00cc6c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55f00715e0 tx=0x7f55e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c476aba985bfae server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55ed59a700 1 -- 172.21.15.106:0/1800141892 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e800e070 con 0x7f55f00c6c30 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55ed59a700 1 -- 172.21.15.106:0/1800141892 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e800bbd0 con 0x7f55f00c6c30 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55ed59a700 1 -- 172.21.15.106:0/1800141892 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8012430 con 0x7f55f00c6c30 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 -- 172.21.15.106:0/1800141892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 msgr2=0x7f55f00cc6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 --2- 172.21.15.106:0/1800141892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f00cc6c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f55f00715e0 tx=0x7f55e800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 -- 172.21.15.106:0/1800141892 shutdown_connections 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 --2- 172.21.15.106:0/1800141892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f00cc6c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.314 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 --2- 172.21.15.106:0/1800141892 >> v2:172.21.15.176:3300/0 conn(0x7f55f015bf50 0x7f55f00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 -- 172.21.15.106:0/1800141892 >> 172.21.15.106:0/1800141892 conn(0x7f55f00b3780 msgr2=0x7f55f00b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 -- 172.21.15.106:0/1800141892 shutdown_connections 2023-11-24T06:14:22.315 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.310+0000 7f55f4851700 1 -- 172.21.15.106:0/1800141892 wait complete. 2023-11-24T06:14:22.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.312+0000 7f55f4851700 1 Processor -- start 2023-11-24T06:14:22.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.312+0000 7f55f4851700 1 -- start start 2023-11-24T06:14:22.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 0x7f55f01f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 0x7f55f009e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0147e80 con 0x7f55f00c6c30 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01f1c60 con 0x7f55f015bf50 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55f4851700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0147200 con 0x7f55f00ce830 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59220/0 (socket says 172.21.15.106:59220) 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 -- 172.21.15.106:0/1552549504 learned_addr learned my addr 172.21.15.106:0/1552549504 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55eed9d700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 0x7f55f009e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55edd9b700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 0x7f55f01f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 -- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 msgr2=0x7f55f01f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 0x7f55f01f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 -- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 msgr2=0x7f55f009e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 0x7f55f009e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 -- 172.21.15.106:0/1552549504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8009a70 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55eed9d700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 0x7f55f009e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55edd9b700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 0x7f55f01f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.313+0000 7f55ee59c700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b4a0 tx=0x7f55e400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011830 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f01474e0 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f0147aa0 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4011990 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4011d00 con 0x7f55f00c6c30 2023-11-24T06:14:22.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.314+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f006e9b0 con 0x7f55f00c6c30 2023-11-24T06:14:22.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.315+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55e401a400 con 0x7f55f00c6c30 2023-11-24T06:14:22.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.315+0000 7f55deffd700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 0x7f55d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.315+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f55e4089690 con 0x7f55f00c6c30 2023-11-24T06:14:22.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.315+0000 7f55edd9b700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 0x7f55d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.316+0000 7f55edd9b700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 0x7f55d006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55e0000f60 tx=0x7f55e0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.320+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55e40546d0 con 0x7f55f00c6c30 2023-11-24T06:14:22.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.510+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55f015b470 con 0x7f55f00c6c30 2023-11-24T06:14:22.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.510+0000 7f55deffd700 1 -- 172.21.15.106:0/1552549504 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55e4011e60 con 0x7f55f00c6c30 2023-11-24T06:14:22.513 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:22.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 msgr2=0x7f55d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 0x7f55d006d390 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f55e0000f60 tx=0x7f55e0009040 comp rx=0 tx=0).stop 2023-11-24T06:14:22.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 msgr2=0x7f55f009bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f55e400b4a0 tx=0x7f55e400b860 comp rx=0 tx=0).stop 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 shutdown_connections 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f55d006aed0 0x7f55d006d390 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55f015bf50 0x7f55f009e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55f00c6c30 0x7f55f009bc50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 --2- 172.21.15.106:0/1552549504 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55f00ce830 0x7f55f01f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 >> 172.21.15.106:0/1552549504 conn(0x7f55f00b3780 msgr2=0x7f55f00c70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 shutdown_connections 2023-11-24T06:14:22.516 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.512+0000 7f55f4851700 1 -- 172.21.15.106:0/1552549504 wait complete. 2023-11-24T06:14:22.527 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.647+0000 7fda6c13b700 1 Processor -- start 2023-11-24T06:14:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 -- start start 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 0x7fda64073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda640b3c60 con 0x7fda640744d0 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda640b4500 con 0x7fda6415e160 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.648+0000 7fda6c13b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda64074960 con 0x7fda640afc90 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda69ed7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 0x7fda64073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda69ed7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:39464/0 (socket says 172.21.15.106:39464) 2023-11-24T06:14:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda69ed7700 1 -- 172.21.15.106:0/3172602030 learned_addr learned my addr 172.21.15.106:0/3172602030 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 -- 172.21.15.106:0/3172602030 >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 msgr2=0x7fda640b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 --2- 172.21.15.106:0/3172602030 >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 -- 172.21.15.106:0/3172602030 >> v1:172.21.15.176:6789/0 conn(0x7fda640744d0 legacy=0x7fda6406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 -- 172.21.15.106:0/3172602030 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda640b58c0 con 0x7fda640afc90 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda68ed5700 1 -- 172.21.15.106:0/3172602030 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1612590015 0 0) 0x7fda640b3c60 con 0x7fda640744d0 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda69ed7700 1 --2- 172.21.15.106:0/3172602030 >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda696d6700 1 --2- 172.21.15.106:0/3172602030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 0x7fda64073f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda60009840 tx=0x7fda60009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc7ba989c384751 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.649+0000 7fda68ed5700 1 -- 172.21.15.106:0/3172602030 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011830 con 0x7fda640afc90 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda68ed5700 1 -- 172.21.15.106:0/3172602030 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda60011990 con 0x7fda640afc90 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda68ed5700 1 -- 172.21.15.106:0/3172602030 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60011d20 con 0x7fda640afc90 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 -- 172.21.15.106:0/3172602030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 msgr2=0x7fda64073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 --2- 172.21.15.106:0/3172602030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 0x7fda64073f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fda60009840 tx=0x7fda60009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 -- 172.21.15.106:0/3172602030 shutdown_connections 2023-11-24T06:14:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 --2- 172.21.15.106:0/3172602030 >> v2:172.21.15.176:3300/0 conn(0x7fda6415e160 0x7fda640b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 --2- 172.21.15.106:0/3172602030 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda640afc90 0x7fda64073f90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 -- 172.21.15.106:0/3172602030 >> 172.21.15.106:0/3172602030 conn(0x7fda640d0bf0 msgr2=0x7fda640d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 -- 172.21.15.106:0/3172602030 shutdown_connections 2023-11-24T06:14:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.650+0000 7fda6c13b700 1 -- 172.21.15.106:0/3172602030 wait complete. 2023-11-24T06:14:22.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.651+0000 7fda6c13b700 1 Processor -- start 2023-11-24T06:14:22.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.651+0000 7fda6c13b700 1 -- start start 2023-11-24T06:14:22.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda640744d0 0x7fda640c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 0x7fda640c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c6650 con 0x7fda640afc90 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda64149b00 con 0x7fda640744d0 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6c13b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda64149de0 con 0x7fda6415e160 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59234/0 (socket says 172.21.15.106:59234) 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 -- 172.21.15.106:0/1735060514 learned_addr learned my addr 172.21.15.106:0/1735060514 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda69ed7700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda640744d0 0x7fda640c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6a6d8700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 0x7fda640c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 -- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 msgr2=0x7fda640c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 0x7fda640c8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 -- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda640744d0 msgr2=0x7fda640c6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda640744d0 0x7fda640c6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda696d6700 1 -- 172.21.15.106:0/1735060514 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009550 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.652+0000 7fda6a6d8700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 0x7fda640c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda696d6700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fda600090b0 tx=0x7fda60004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600038a0 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6001f070 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda600094a0 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60003c00 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.653+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6414a3a0 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.654+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6415dd10 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.654+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda6001a430 con 0x7fda640afc90 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.655+0000 7fda5a7fc700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 0x7fda4806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.655+0000 7fda69ed7700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 0x7fda4806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.655+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda60021070 con 0x7fda640afc90 2023-11-24T06:14:22.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.655+0000 7fda69ed7700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 0x7fda4806d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda54009c50 tx=0x7fda54008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.659+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda60055fd0 con 0x7fda640afc90 2023-11-24T06:14:22.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.850+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fda64068fb0 con 0x7fda640afc90 2023-11-24T06:14:22.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.850+0000 7fda5a7fc700 1 -- 172.21.15.106:0/1735060514 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fda600595f0 con 0x7fda640afc90 2023-11-24T06:14:22.853 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:22.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 msgr2=0x7fda4806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 0x7fda4806d390 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fda54009c50 tx=0x7fda54008040 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 msgr2=0x7fda64149010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fda600090b0 tx=0x7fda60004750 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 shutdown_connections 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda4806aed0 0x7fda4806d390 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda6415e160 0x7fda640c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda640744d0 0x7fda640c6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 --2- 172.21.15.106:0/1735060514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda640afc90 0x7fda64149010 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.852+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 >> 172.21.15.106:0/1735060514 conn(0x7fda640d0bf0 msgr2=0x7fda640add40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.853+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 shutdown_connections 2023-11-24T06:14:22.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.853+0000 7fda6c13b700 1 -- 172.21.15.106:0/1735060514 wait complete. 2023-11-24T06:14:22.867 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:22.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.988+0000 7f09b25a3700 1 Processor -- start 2023-11-24T06:14:22.991 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.988+0000 7f09b25a3700 1 -- start start 2023-11-24T06:14:22.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09b25a3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac15be70 0x7f09ac0cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09b25a3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09ac0add40 0x7f09ac073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09b25a3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09ac0b5ee0 con 0x7f09ac0744d0 2023-11-24T06:14:22.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09b25a3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09ac06bfc0 con 0x7f09ac0add40 2023-11-24T06:14:22.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09b25a3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac074960 con 0x7f09ac15be70 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09ac0add40 0x7f09ac073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09abfff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac15be70 0x7f09ac0cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f09ac0add40 0x7f09ac073f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:39480/0 (socket says 172.21.15.106:39480) 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 -- 172.21.15.106:0/355552257 learned_addr learned my addr 172.21.15.106:0/355552257 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 -- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac15be70 msgr2=0x7f09ac0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 --2- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac15be70 0x7f09ac0cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 -- 172.21.15.106:0/355552257 >> v1:172.21.15.176:6789/0 conn(0x7f09ac0744d0 legacy=0x7f09ac0af710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 -- 172.21.15.106:0/355552257 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac06ba00 con 0x7f09ac0add40 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.989+0000 7f09ab7fe700 1 --2- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac073f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09a00098f0 tx=0x7f09a0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a000bd64a12ee4c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09aaffd700 1 -- 172.21.15.106:0/355552257 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a0004230 con 0x7f09ac0add40 2023-11-24T06:14:22.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09aaffd700 1 -- 172.21.15.106:0/355552257 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a0004390 con 0x7f09ac0add40 2023-11-24T06:14:22.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09aaffd700 1 -- 172.21.15.106:0/355552257 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a00036a0 con 0x7f09ac0add40 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 -- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 msgr2=0x7f09ac073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 --2- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac073f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f09a00098f0 tx=0x7f09a0009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 -- 172.21.15.106:0/355552257 shutdown_connections 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 --2- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac15be70 0x7f09ac0cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 --2- 172.21.15.106:0/355552257 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac073f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 -- 172.21.15.106:0/355552257 >> 172.21.15.106:0/355552257 conn(0x7f09ac0d0bf0 msgr2=0x7f09ac0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 -- 172.21.15.106:0/355552257 shutdown_connections 2023-11-24T06:14:22.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.990+0000 7f09b25a3700 1 -- 172.21.15.106:0/355552257 wait complete. 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.991+0000 7f09b25a3700 1 Processor -- start 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 -- start start 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac0744d0 0x7f09ac15c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15c910 con 0x7f09ac15be70 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15cbb0 con 0x7f09ac0add40 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b25a3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09ac15ce90 con 0x7f09ac0744d0 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b0b40700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b0b40700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59250/0 (socket says 172.21.15.106:59250) 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.992+0000 7f09b0b40700 1 -- 172.21.15.106:0/2521198042 learned_addr learned my addr 172.21.15.106:0/2521198042 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:22.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09abfff700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac0744d0 0x7f09ac15c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 -- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac0744d0 msgr2=0x7f09ac15c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac0744d0 0x7f09ac15c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 -- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 msgr2=0x7f09ac14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 -- 172.21.15.106:0/2521198042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0009550 con 0x7f09ac15be70 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b0b40700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b780 tx=0x7f09a400bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400f840 con 0x7f09ac15be70 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a400f9a0 con 0x7f09ac15be70 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09ac15d170 con 0x7f09ac15be70 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a400fd50 con 0x7f09ac15be70 2023-11-24T06:14:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.993+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09ac15d730 con 0x7f09ac15be70 2023-11-24T06:14:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.994+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09ac15d8f0 con 0x7f09ac15be70 2023-11-24T06:14:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.994+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09a40203f0 con 0x7f09ac15be70 2023-11-24T06:14:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.995+0000 7f09a8ff9700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 0x7f099806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.995+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f09a40899d0 con 0x7f09ac15be70 2023-11-24T06:14:23.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.995+0000 7f09abfff700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 0x7f099806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.995+0000 7f09abfff700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 0x7f099806d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f099c009ad0 tx=0x7f099c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:22.999+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09a4054a90 con 0x7f09ac15be70 2023-11-24T06:14:23.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.193+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09ac068fb0 con 0x7f09ac15be70 2023-11-24T06:14:23.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.194+0000 7f09a8ff9700 1 -- 172.21.15.106:0/2521198042 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f09a40580b0 con 0x7f09ac15be70 2023-11-24T06:14:23.197 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 msgr2=0x7f099806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 0x7f099806d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f099c009ad0 tx=0x7f099c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 msgr2=0x7f09ac15dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b780 tx=0x7f09a400bb40 comp rx=0 tx=0).stop 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 shutdown_connections 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f099806aed0 0x7f099806d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09ac15be70 0x7f09ac15dc50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f09ac0744d0 0x7f09ac15c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 --2- 172.21.15.106:0/2521198042 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f09ac0add40 0x7f09ac14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 >> 172.21.15.106:0/2521198042 conn(0x7f09ac0d0bf0 msgr2=0x7f09ac0b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:23.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 shutdown_connections 2023-11-24T06:14:23.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.196+0000 7f09b25a3700 1 -- 172.21.15.106:0/2521198042 wait complete. 2023-11-24T06:14:23.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:23.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.329+0000 7f4184e76700 1 Processor -- start 2023-11-24T06:14:23.332 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.329+0000 7f4184e76700 1 -- start start 2023-11-24T06:14:23.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f4184e76700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f418015e080 0x7f41800b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f4184e76700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ae430 con 0x7f418006c710 2023-11-24T06:14:23.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f4184e76700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41800ae710 con 0x7f41800af4d0 2023-11-24T06:14:23.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f4184e76700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41800af0b0 con 0x7f418015e080 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417e59c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f418015e080 0x7f41800b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417ed9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f418006c710 0x7f418006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39520/0 (socket says 172.21.15.106:39520) 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417ed9d700 1 -- 172.21.15.106:0/3454851996 learned_addr learned my addr 172.21.15.106:0/3454851996 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417e59c700 1 -- 172.21.15.106:0/3454851996 >> v1:172.21.15.176:6789/0 conn(0x7f41800af4d0 legacy=0x7f418006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417e59c700 1 -- 172.21.15.106:0/3454851996 >> v1:172.21.15.106:6789/0 conn(0x7f418006c710 legacy=0x7f418006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417d59a700 1 -- 172.21.15.106:0/3454851996 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197139008 0 0) 0x7f41800ae430 con 0x7f418006c710 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417e59c700 1 -- 172.21.15.106:0/3454851996 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41800ae9f0 con 0x7f418015e080 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.330+0000 7f417e59c700 1 --2- 172.21.15.106:0/3454851996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418015e080 0x7f41800b5050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4174009840 tx=0x7f4174009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4317308a42c041a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f417d59a700 1 -- 172.21.15.106:0/3454851996 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011830 con 0x7f418015e080 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f417d59a700 1 -- 172.21.15.106:0/3454851996 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011990 con 0x7f418015e080 2023-11-24T06:14:23.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f417d59a700 1 -- 172.21.15.106:0/3454851996 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011d20 con 0x7f418015e080 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 -- 172.21.15.106:0/3454851996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418015e080 msgr2=0x7f41800b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 --2- 172.21.15.106:0/3454851996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418015e080 0x7f41800b5050 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4174009840 tx=0x7f4174009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 -- 172.21.15.106:0/3454851996 shutdown_connections 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 --2- 172.21.15.106:0/3454851996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418015e080 0x7f41800b5050 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 -- 172.21.15.106:0/3454851996 >> 172.21.15.106:0/3454851996 conn(0x7f4180071b90 msgr2=0x7f4180071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:23.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 -- 172.21.15.106:0/3454851996 shutdown_connections 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.331+0000 7f4184e76700 1 -- 172.21.15.106:0/3454851996 wait complete. 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 Processor -- start 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 -- start start 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 0x7f418015f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f418015e080 0x7f41800c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180149ce0 con 0x7f418006c710 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180160210 con 0x7f41800af4d0 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f4184e76700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41801604f0 con 0x7f418015e080 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f417e59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f417e59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59260/0 (socket says 172.21.15.106:59260) 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.333+0000 7f417e59c700 1 -- 172.21.15.106:0/3331417922 learned_addr learned my addr 172.21.15.106:0/3331417922 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417dd9b700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 0x7f418015f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 -- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f418015e080 msgr2=0x7f41800c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f418015e080 0x7f41800c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 -- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 msgr2=0x7f418015f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 0x7f418015f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 -- 172.21.15.106:0/3331417922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740094a0 con 0x7f418006c710 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417dd9b700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 0x7f418015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f417e59c700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4174014040 tx=0x7f4174004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417401a980 con 0x7f418006c710 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417401ab00 con 0x7f418006c710 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174024420 con 0x7f418006c710 2023-11-24T06:14:23.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801607d0 con 0x7f418006c710 2023-11-24T06:14:23.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.334+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4180160d90 con 0x7f418006c710 2023-11-24T06:14:23.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.335+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41800753f0 con 0x7f418006c710 2023-11-24T06:14:23.340 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.336+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4174022070 con 0x7f418006c710 2023-11-24T06:14:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.336+0000 7f416effd700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 0x7f416006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.336+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f417408a600 con 0x7f418006c710 2023-11-24T06:14:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.336+0000 7f417dd9b700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 0x7f416006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.336+0000 7f417dd9b700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 0x7f416006d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4180158100 tx=0x7f4170009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.340+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41740556c0 con 0x7f418006c710 2023-11-24T06:14:23.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.571+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4180160f20 con 0x7f418006c710 2023-11-24T06:14:23.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.571+0000 7f416effd700 1 -- 172.21.15.106:0/3331417922 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7f4174058ce0 con 0x7f418006c710 2023-11-24T06:14:23.574 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:23.574 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 msgr2=0x7f416006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 0x7f416006d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f4180158100 tx=0x7f4170009040 comp rx=0 tx=0).stop 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 msgr2=0x7f41801497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4174014040 tx=0x7f4174004750 comp rx=0 tx=0).stop 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 shutdown_connections 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f416006aed0 0x7f416006d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f418015e080 0x7f41800c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f418006c710 0x7f41801497a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 --2- 172.21.15.106:0/3331417922 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f41800af4d0 0x7f418015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 >> 172.21.15.106:0/3331417922 conn(0x7f4180071b90 msgr2=0x7f41800b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 shutdown_connections 2023-11-24T06:14:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.574+0000 7f4184e76700 1 -- 172.21.15.106:0/3331417922 wait complete. 2023-11-24T06:14:23.578 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:14:23.589 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:23.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.706+0000 7f4115dcf700 1 Processor -- start 2023-11-24T06:14:23.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.706+0000 7f4115dcf700 1 -- start start 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f4115dcf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f411006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f4115dcf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f41100d0630 0x7f411006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f4115dcf700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411015c4b0 con 0x7f41100b49a0 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f4115dcf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411015c790 con 0x7f41100d0630 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f4115dcf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411015ca70 con 0x7f4110152cc0 2023-11-24T06:14:23.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410effd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f41100b49a0 0x7f41100cff20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39532/0 (socket says 172.21.15.106:39532) 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410effd700 1 -- 172.21.15.106:0/1927536652 learned_addr learned my addr 172.21.15.106:0/1927536652 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> v2:172.21.15.176:3300/0 conn(0x7f41100d0630 0x7f411006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410f7fe700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f411006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395510868 0 0) 0x7f411015c4b0 con 0x7f41100b49a0 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f80035b0 con 0x7f41100b49a0 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3026962766 0 0) 0x7f40f80035b0 con 0x7f41100b49a0 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 msgr2=0x7f411006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f411006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 >> v2:172.21.15.176:3300/0 conn(0x7f41100d0630 msgr2=0x7f411006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 --2- 172.21.15.106:0/1927536652 >> v2:172.21.15.176:3300/0 conn(0x7f41100d0630 0x7f411006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411015cd50 con 0x7f41100b49a0 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f4100001670 con 0x7f41100b49a0 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 >> v1:172.21.15.106:6789/0 conn(0x7f41100b49a0 legacy=0x7f41100cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40f8003a00 0x7f40f8003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.707+0000 7f410e7fc700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f40f8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40f8004d90 0x7f40f8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411015c790 con 0x7f40f8004d90 2023-11-24T06:14:23.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411015ca70 con 0x7f40f8003a00 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f800ba90 con 0x7f4110152cc0 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> v2:172.21.15.176:3300/0 conn(0x7f41100d0630 0x7f411006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40f8004d90 0x7f40f8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410f7fe700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40f8003a00 0x7f40f8003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410effd700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f40f8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 -- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 msgr2=0x7f40f8004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4110152cc0 0x7f40f8004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 -- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40f8003a00 msgr2=0x7f40f8003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f40f8003a00 0x7f40f8003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 -- 172.21.15.106:0/1927536652 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f80035b0 con 0x7f40f8004d90 2023-11-24T06:14:23.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410ffff700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40f8004d90 0x7f40f8005210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f410800e350 tx=0x7f40f8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7db3bcffcfad6b2f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f410800ee10 con 0x7f40f8004d90 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410800f040 con 0x7f40f8004d90 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.708+0000 7f410e7fc700 1 -- 172.21.15.106:0/1927536652 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108003c40 con 0x7f40f8004d90 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 -- 172.21.15.106:0/1927536652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40f8004d90 msgr2=0x7f40f8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 --2- 172.21.15.106:0/1927536652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40f8004d90 0x7f40f8005210 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f410800e350 tx=0x7f40f8005880 comp rx=0 tx=0).stop 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f410ffff700 1 -- 172.21.15.106:0/1927536652 reap_dead start 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 -- 172.21.15.106:0/1927536652 shutdown_connections 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 -- 172.21.15.106:0/1927536652 >> 172.21.15.106:0/1927536652 conn(0x7f4110071b90 msgr2=0x7f4110071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 -- 172.21.15.106:0/1927536652 shutdown_connections 2023-11-24T06:14:23.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.709+0000 7f4115dcf700 1 -- 172.21.15.106:0/1927536652 wait complete. 2023-11-24T06:14:23.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.710+0000 7f4115dcf700 1 Processor -- start 2023-11-24T06:14:23.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.710+0000 7f4115dcf700 1 -- start start 2023-11-24T06:14:23.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4110139fd0 0x7f4110155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411014b8d0 0x7f411014cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411014caa0 con 0x7f411014d470 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411014be90 con 0x7f4110139fd0 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f4115dcf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411014c170 con 0x7f411014b8d0 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59284/0 (socket says 172.21.15.106:59284) 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 -- 172.21.15.106:0/3576713678 learned_addr learned my addr 172.21.15.106:0/3576713678 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410f7fe700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4110139fd0 0x7f4110155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410effd700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411014b8d0 0x7f411014cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 -- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411014b8d0 msgr2=0x7f411014cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411014b8d0 0x7f411014cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 -- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4110139fd0 msgr2=0x7f4110155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4110139fd0 0x7f4110155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 -- 172.21.15.106:0/3576713678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411014c450 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.711+0000 7f410ffff700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4108004000 tx=0x7f4108009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.712+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108004440 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.712+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41080045c0 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.712+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4108004970 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.712+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411014c730 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.712+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4110156240 con 0x7f411014d470 2023-11-24T06:14:23.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.713+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41100753f0 con 0x7f411014d470 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.713+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4108025020 con 0x7f411014d470 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.713+0000 7f40f7fff700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 0x7f40fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.713+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f410808b5e0 con 0x7f411014d470 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.713+0000 7f410f7fe700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 0x7f40fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.714+0000 7f410f7fe700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 0x7f40fc06d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4104009b20 tx=0x7f4104008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:23.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.718+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41080567c0 con 0x7f411014d470 2023-11-24T06:14:23.916 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.913+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4110067f60 con 0x7f411014d470 2023-11-24T06:14:23.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.915+0000 7f40f7fff700 1 -- 172.21.15.106:0/3576713678 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16779 (secure 0 0 0) 0x7f4108059de0 con 0x7f411014d470 2023-11-24T06:14:23.918 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:23.918 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:23.163469+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 msgr2=0x7f40fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 0x7f40fc06d390 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4104009b20 tx=0x7f4104008040 comp rx=0 tx=0).stop 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 msgr2=0x7f41101500e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4108004000 tx=0x7f4108009750 comp rx=0 tx=0).stop 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 shutdown_connections 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f40fc06aed0 0x7f40fc06d390 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f411014d470 0x7f41101500e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4110139fd0 0x7f4110155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 --2- 172.21.15.106:0/3576713678 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f411014b8d0 0x7f411014cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:23.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 >> 172.21.15.106:0/3576713678 conn(0x7f4110071b90 msgr2=0x7f41100746c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:23.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 shutdown_connections 2023-11-24T06:14:23.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:23.917+0000 7f4115dcf700 1 -- 172.21.15.106:0/3576713678 wait complete. 2023-11-24T06:14:23.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:14:23.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:24.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.051+0000 7fd5d772f700 1 Processor -- start 2023-11-24T06:14:24.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.051+0000 7fd5d772f700 1 -- start start 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d772f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5d006c710 0x7fd5d00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d772f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d00af4d0 0x7fd5d00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d772f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00ae430 con 0x7fd5d015e080 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d772f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00af0b0 con 0x7fd5d006c710 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d772f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d00b05a0 con 0x7fd5d00af4d0 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5d006c710 0x7fd5d00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d54cb700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd5d015e080 0x7fd5d006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39550/0 (socket says 172.21.15.106:39550) 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d54cb700 1 -- 172.21.15.106:0/2314090082 learned_addr learned my addr 172.21.15.106:0/2314090082 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d5ccc700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d00af4d0 0x7fd5d00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 -- 172.21.15.106:0/2314090082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d00af4d0 msgr2=0x7fd5d00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d00af4d0 0x7fd5d00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 -- 172.21.15.106:0/2314090082 >> v1:172.21.15.106:6789/0 conn(0x7fd5d015e080 legacy=0x7fd5d006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5c7fff700 1 -- 172.21.15.106:0/2314090082 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783828033 0 0) 0x7fd5d00ae430 con 0x7fd5d015e080 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 -- 172.21.15.106:0/2314090082 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d00ae710 con 0x7fd5d006c710 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5d4cca700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d00b5050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009840 tx=0x7fd5c0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc3daea29a4bd73 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.052+0000 7fd5c7fff700 1 -- 172.21.15.106:0/2314090082 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0011830 con 0x7fd5d006c710 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5c7fff700 1 -- 172.21.15.106:0/2314090082 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c0011990 con 0x7fd5d006c710 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5c7fff700 1 -- 172.21.15.106:0/2314090082 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0011d20 con 0x7fd5d006c710 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 -- 172.21.15.106:0/2314090082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 msgr2=0x7fd5d00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d00b5050 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009840 tx=0x7fd5c0009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 -- 172.21.15.106:0/2314090082 shutdown_connections 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d00af4d0 0x7fd5d00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 --2- 172.21.15.106:0/2314090082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d00b5050 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 -- 172.21.15.106:0/2314090082 >> 172.21.15.106:0/2314090082 conn(0x7fd5d0071b90 msgr2=0x7fd5d0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 -- 172.21.15.106:0/2314090082 shutdown_connections 2023-11-24T06:14:24.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.053+0000 7fd5d772f700 1 -- 172.21.15.106:0/2314090082 wait complete. 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.054+0000 7fd5d772f700 1 Processor -- start 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.054+0000 7fd5d772f700 1 -- start start 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d00af4d0 0x7fd5d015f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 0x7fd5d015f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d015ed70 con 0x7fd5d006c710 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0151c60 con 0x7fd5d00af4d0 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d772f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d015e460 con 0x7fd5d015e080 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59294/0 (socket says 172.21.15.106:59294) 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 -- 172.21.15.106:0/3573114360 learned_addr learned my addr 172.21.15.106:0/3573114360 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d5ccc700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 0x7fd5d015f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d4cca700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d00af4d0 0x7fd5d015f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 -- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 msgr2=0x7fd5d015f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 0x7fd5d015f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 -- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d00af4d0 msgr2=0x7fd5d015f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d00af4d0 0x7fd5d015f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d54cb700 1 -- 172.21.15.106:0/3573114360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c00094a0 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.055+0000 7fd5d5ccc700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 0x7fd5d015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5d54cb700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c580 tx=0x7fd5cc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc004c80 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc004e00 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d01f7a80 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc007310 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.056+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d015e990 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.057+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d00753f0 con 0x7fd5d006c710 2023-11-24T06:14:24.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.057+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5cc007470 con 0x7fd5d006c710 2023-11-24T06:14:24.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.058+0000 7fd5c5ffb700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 0x7fd5b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.058+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd5cc0892a0 con 0x7fd5d006c710 2023-11-24T06:14:24.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.058+0000 7fd5d4cca700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 0x7fd5b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.058+0000 7fd5d4cca700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 0x7fd5b406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00090b0 tx=0x7fd5c0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.062+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5cc054360 con 0x7fd5d006c710 2023-11-24T06:14:24.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.299+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5d00d0970 con 0x7fd5d006c710 2023-11-24T06:14:24.302 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.300+0000 7fd5c5ffb700 1 -- 172.21.15.106:0/3573114360 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fd5cc057980 con 0x7fd5d006c710 2023-11-24T06:14:24.303 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:24.303 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:14:24.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 msgr2=0x7fd5b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 0x7fd5b406d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd5c00090b0 tx=0x7fd5c0008030 comp rx=0 tx=0).stop 2023-11-24T06:14:24.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 msgr2=0x7fd5d0151720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.305 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00c580 tx=0x7fd5cc00c940 comp rx=0 tx=0).stop 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 shutdown_connections 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd5b406aed0 0x7fd5b406d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd5d015e080 0x7fd5d015f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5d006c710 0x7fd5d0151720 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 --2- 172.21.15.106:0/3573114360 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd5d00af4d0 0x7fd5d015f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 >> 172.21.15.106:0/3573114360 conn(0x7fd5d0071b90 msgr2=0x7fd5d00b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 shutdown_connections 2023-11-24T06:14:24.306 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.302+0000 7fd5d772f700 1 -- 172.21.15.106:0/3573114360 wait complete. 2023-11-24T06:14:24.307 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:14:24.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:24.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.434+0000 7fcbe32ec700 1 Processor -- start 2023-11-24T06:14:24.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 -- start start 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 0x7fcbdc1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0d1c70 0x7fcbdc0d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b2f50 con 0x7fcbdc0b3370 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbdc0d2660 con 0x7fcbdc15bdd0 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe32ec700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b2030 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.435+0000 7fcbe0887700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.440 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59302/0 (socket says 172.21.15.106:59302) 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 -- 172.21.15.106:0/3333390467 learned_addr learned my addr 172.21.15.106:0/3333390467 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe1889700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0d1c70 0x7fcbdc0d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe1088700 1 --2- 172.21.15.106:0/3333390467 >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 0x7fcbdc1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 -- 172.21.15.106:0/3333390467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0d1c70 msgr2=0x7fcbdc0d2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0d1c70 0x7fcbdc0d2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 -- 172.21.15.106:0/3333390467 >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 msgr2=0x7fcbdc1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 --2- 172.21.15.106:0/3333390467 >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 0x7fcbdc1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 -- 172.21.15.106:0/3333390467 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0b22d0 con 0x7fcbdc0b3370 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe1088700 1 --2- 172.21.15.106:0/3333390467 >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 0x7fcbdc1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:24.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbe0887700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc06ec10 tx=0x7fcbd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c746eab3e49d50ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbd3fff700 1 -- 172.21.15.106:0/3333390467 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800b870 con 0x7fcbdc0b3370 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbd3fff700 1 -- 172.21.15.106:0/3333390467 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd800b9d0 con 0x7fcbdc0b3370 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.436+0000 7fcbd3fff700 1 -- 172.21.15.106:0/3333390467 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd800bd60 con 0x7fcbdc0b3370 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 -- 172.21.15.106:0/3333390467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0b3370 msgr2=0x7fcbdc0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc06ec10 tx=0x7fcbd8009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 -- 172.21.15.106:0/3333390467 shutdown_connections 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0d1c70 0x7fcbdc0d2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/3333390467 >> v2:172.21.15.176:3300/0 conn(0x7fcbdc15bdd0 0x7fcbdc1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/3333390467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0b3370 0x7fcbdc0b1af0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 -- 172.21.15.106:0/3333390467 >> 172.21.15.106:0/3333390467 conn(0x7fcbdc0731a0 msgr2=0x7fcbdc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:24.442 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 -- 172.21.15.106:0/3333390467 shutdown_connections 2023-11-24T06:14:24.443 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.437+0000 7fcbe32ec700 1 -- 172.21.15.106:0/3333390467 wait complete. 2023-11-24T06:14:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.438+0000 7fcbe32ec700 1 Processor -- start 2023-11-24T06:14:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.438+0000 7fcbe32ec700 1 -- start start 2023-11-24T06:14:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0b3370 0x7fcbdc0c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.445 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 0x7fcbdc06fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c6240 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c6520 con 0x7fcbdc15bdd0 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0c6800 con 0x7fcbdc0b3370 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59310/0 (socket says 172.21.15.106:59310) 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 -- 172.21.15.106:0/1042189808 learned_addr learned my addr 172.21.15.106:0/1042189808 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe1088700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0b3370 0x7fcbdc0c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe1889700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 0x7fcbdc06fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 -- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0b3370 msgr2=0x7fcbdc0c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0b3370 0x7fcbdc0c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.446 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 -- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 msgr2=0x7fcbdc06fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 0x7fcbdc06fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 -- 172.21.15.106:0/1042189808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd8009550 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe1889700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 0x7fcbdc06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe0887700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8000c00 tx=0x7fcbd8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8004540 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80036a0 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc0c6ae0 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.439+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8003a50 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.440+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc0c7820 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.440+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc067f60 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.447 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.441+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbd8021070 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.441+0000 7fcbd1ffb700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 0x7fcbc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.441+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcbd808ac50 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.441+0000 7fcbe1088700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 0x7fcbc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.442+0000 7fcbe1088700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 0x7fcbc006d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.448 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.446+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbd8090020 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.678+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbdc0b7c60 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.679+0000 7fcbd1ffb700 1 -- 172.21.15.106:0/1042189808 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4916 (secure 0 0 0) 0x7fcbd8015090 con 0x7fcbdc0d1c70 2023-11-24T06:14:24.681 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:24.681 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/224000895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":224000895},{"type":"v1","addr":"172.21.15.106:6836","nonce":224000895}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3731043293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":3731043293},{"type":"v1","addr":"172.21.15.106:6837","nonce":3731043293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/3051406071","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":3051406071},{"type":"v1","addr":"172.21.15.176:6834","nonce":3051406071}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:13:41.314153+0000","modified":"2023-11-24T06:13:44.337653+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.176:6835/4280937312","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4280937312},{"type":"v1","addr":"172.21.15.176:6835","nonce":4280937312}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 msgr2=0x7fcbc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 0x7fcbc006d390 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc006fd0 tx=0x7fcbcc008040 comp rx=0 tx=0).stop 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 msgr2=0x7fcbdc157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8000c00 tx=0x7fcbd8004750 comp rx=0 tx=0).stop 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 shutdown_connections 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fcbc006aed0 0x7fcbc006d390 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fcbdc15bdd0 0x7fcbdc06fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fcbdc0b3370 0x7fcbdc0c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 --2- 172.21.15.106:0/1042189808 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbdc0d1c70 0x7fcbdc157140 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 >> 172.21.15.106:0/1042189808 conn(0x7fcbdc0731a0 msgr2=0x7fcbdc0aea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 shutdown_connections 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.681+0000 7fcbe32ec700 1 -- 172.21.15.106:0/1042189808 wait complete. 2023-11-24T06:14:24.685 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 8 2023-11-24T06:14:24.696 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:24.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.814+0000 7fb6e7271700 1 Processor -- start 2023-11-24T06:14:24.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.814+0000 7fb6e7271700 1 -- start start 2023-11-24T06:14:24.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e7271700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6e015e080 0x7fb6e00b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e7271700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 0x7fb6e00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e7271700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6e00ae430 con 0x7fb6e006c000 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e7271700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00af0b0 con 0x7fb6e015e080 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e7271700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6e00b05a0 con 0x7fb6e00af4d0 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e500d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6e015e080 0x7fb6e00b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e580e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb6e006c000 0x7fb6e0073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39582/0 (socket says 172.21.15.106:39582) 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e580e700 1 -- 172.21.15.106:0/1165902395 learned_addr learned my addr 172.21.15.106:0/1165902395 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.815+0000 7fb6e480c700 1 --2- 172.21.15.106:0/1165902395 >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 0x7fb6e00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e500d700 1 -- 172.21.15.106:0/1165902395 >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 msgr2=0x7fb6e00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e500d700 1 --2- 172.21.15.106:0/1165902395 >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 0x7fb6e00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e500d700 1 -- 172.21.15.106:0/1165902395 >> v1:172.21.15.106:6789/0 conn(0x7fb6e006c000 legacy=0x7fb6e0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e500d700 1 -- 172.21.15.106:0/1165902395 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e00ae710 con 0x7fb6e015e080 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6d7fff700 1 -- 172.21.15.106:0/1165902395 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188347166 0 0) 0x7fb6e00ae430 con 0x7fb6e006c000 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e480c700 1 --2- 172.21.15.106:0/1165902395 >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 0x7fb6e00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e500d700 1 --2- 172.21.15.106:0/1165902395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e015e080 0x7fb6e00b5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006e4e0 tx=0x7fb6dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9785e383507c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6d7fff700 1 -- 172.21.15.106:0/1165902395 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011830 con 0x7fb6e015e080 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6d7fff700 1 -- 172.21.15.106:0/1165902395 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc011990 con 0x7fb6e015e080 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6d7fff700 1 -- 172.21.15.106:0/1165902395 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc011d20 con 0x7fb6e015e080 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 -- 172.21.15.106:0/1165902395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e015e080 msgr2=0x7fb6e00b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 --2- 172.21.15.106:0/1165902395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e015e080 0x7fb6e00b5050 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006e4e0 tx=0x7fb6dc009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 -- 172.21.15.106:0/1165902395 shutdown_connections 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 --2- 172.21.15.106:0/1165902395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e015e080 0x7fb6e00b5050 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 --2- 172.21.15.106:0/1165902395 >> v2:172.21.15.176:3300/0 conn(0x7fb6e00af4d0 0x7fb6e00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 -- 172.21.15.106:0/1165902395 >> 172.21.15.106:0/1165902395 conn(0x7fb6e0071b90 msgr2=0x7fb6e0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:24.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.816+0000 7fb6e7271700 1 -- 172.21.15.106:0/1165902395 shutdown_connections 2023-11-24T06:14:24.822 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.817+0000 7fb6e7271700 1 -- 172.21.15.106:0/1165902395 wait complete. 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 Processor -- start 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 -- start start 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 0x7fb6e015e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 0x7fb6e0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015ef70 con 0x7fb6e006c000 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015f250 con 0x7fb6e00af4d0 2023-11-24T06:14:24.825 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e7271700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6e015f530 con 0x7fb6e015e080 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.818+0000 7fb6e500d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59322/0 (socket says 172.21.15.106:59322) 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 -- 172.21.15.106:0/142443833 learned_addr learned my addr 172.21.15.106:0/142443833 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e580e700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 0x7fb6e0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 -- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 msgr2=0x7fb6e0153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e480c700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 0x7fb6e015e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 0x7fb6e0153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 -- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 msgr2=0x7fb6e015e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 0x7fb6e015e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:24.826 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 -- 172.21.15.106:0/142443833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0094a0 con 0x7fb6e006c000 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e580e700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 0x7fb6e0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e480c700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 0x7fb6e015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e500d700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc014040 tx=0x7fb6dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc0038a0 con 0x7fb6e006c000 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6dc01e070 con 0x7fb6e006c000 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e015f810 con 0x7fb6e006c000 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc003c40 con 0x7fb6e006c000 2023-11-24T06:14:24.827 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.819+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6e014abe0 con 0x7fb6e006c000 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.820+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6e00753f0 con 0x7fb6e006c000 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.821+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6dc02d450 con 0x7fb6e006c000 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.821+0000 7fb6d5ffb700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 0x7fb6c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.821+0000 7fb6e480c700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 0x7fb6c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.821+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb6dc08a730 con 0x7fb6e006c000 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.822+0000 7fb6e480c700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 0x7fb6c406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0156d60 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:24.828 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:24.826+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6dc0557f0 con 0x7fb6e006c000 2023-11-24T06:14:25.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.018+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6e00d09b0 con 0x7fb6e006c000 2023-11-24T06:14:25.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.019+0000 7fb6d5ffb700 1 -- 172.21.15.106:0/142443833 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16779 (secure 0 0 0) 0x7fb6dc058e10 con 0x7fb6e006c000 2023-11-24T06:14:25.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:25.023 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":22,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:23.163469+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:13:39.020185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-24T06:13:40.278324+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":1}]},{"pgid":"3.16","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:25.024 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 msgr2=0x7fb6c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 0x7fb6c406d390 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb6e0156d60 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 msgr2=0x7fb6e013e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc014040 tx=0x7fb6dc004750 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 shutdown_connections 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c406aed0 0x7fb6c406d390 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6e015e080 0x7fb6e0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6e006c000 0x7fb6e013e2c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 --2- 172.21.15.106:0/142443833 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6e00af4d0 0x7fb6e015e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.021+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 >> 172.21.15.106:0/142443833 conn(0x7fb6e0071b90 msgr2=0x7fb6e00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.022+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 shutdown_connections 2023-11-24T06:14:25.025 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.022+0000 7fb6e7271700 1 -- 172.21.15.106:0/142443833 wait complete. 2023-11-24T06:14:25.036 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:14:25.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.154+0000 7fb24c282700 1 Processor -- start 2023-11-24T06:14:25.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.154+0000 7fb24c282700 1 -- start start 2023-11-24T06:14:25.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24c282700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2440af4d0 0x7fb2440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24c282700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440ae430 con 0x7fb24415e080 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24c282700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2440ae710 con 0x7fb24406c710 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24c282700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2440af0b0 con 0x7fb2440af4d0 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24a81f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2440af4d0 0x7fb2440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24a01e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb24415e080 0x7fb24406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39592/0 (socket says 172.21.15.106:39592) 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.155+0000 7fb24a01e700 1 -- 172.21.15.106:0/1472541114 learned_addr learned my addr 172.21.15.106:0/1472541114 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24a81f700 1 -- 172.21.15.106:0/1472541114 >> v1:172.21.15.176:6789/0 conn(0x7fb24406c710 legacy=0x7fb24406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24a81f700 1 -- 172.21.15.106:0/1472541114 >> v1:172.21.15.106:6789/0 conn(0x7fb24415e080 legacy=0x7fb24406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24a81f700 1 -- 172.21.15.106:0/1472541114 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2440ae9f0 con 0x7fb2440af4d0 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24901c700 1 -- 172.21.15.106:0/1472541114 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906477031 0 0) 0x7fb2440ae430 con 0x7fb24415e080 2023-11-24T06:14:25.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24a81f700 1 --2- 172.21.15.106:0/1472541114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2440b5050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53acdfaa266e0191 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24901c700 1 -- 172.21.15.106:0/1472541114 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c00e070 con 0x7fb2440af4d0 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24901c700 1 -- 172.21.15.106:0/1472541114 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb23c00bbd0 con 0x7fb2440af4d0 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.156+0000 7fb24901c700 1 -- 172.21.15.106:0/1472541114 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb23c012430 con 0x7fb2440af4d0 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 -- 172.21.15.106:0/1472541114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 msgr2=0x7fb2440b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 --2- 172.21.15.106:0/1472541114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2440b5050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009d90 tx=0x7fb23c00b330 comp rx=0 tx=0).stop 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 -- 172.21.15.106:0/1472541114 shutdown_connections 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 --2- 172.21.15.106:0/1472541114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2440b5050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 -- 172.21.15.106:0/1472541114 >> 172.21.15.106:0/1472541114 conn(0x7fb244071b90 msgr2=0x7fb244071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 -- 172.21.15.106:0/1472541114 shutdown_connections 2023-11-24T06:14:25.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.157+0000 7fb24c282700 1 -- 172.21.15.106:0/1472541114 wait complete. 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.158+0000 7fb24c282700 1 Processor -- start 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.158+0000 7fb24c282700 1 -- start start 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb24406c710 0x7fb244155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24415e080 0x7fb2440ce670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244156020 con 0x7fb2440af4d0 2023-11-24T06:14:25.164 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb244156300 con 0x7fb24406c710 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2441565e0 con 0x7fb24415e080 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59336/0 (socket says 172.21.15.106:59336) 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 -- 172.21.15.106:0/2959645887 learned_addr learned my addr 172.21.15.106:0/2959645887 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24a01e700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb24406c710 0x7fb244155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 -- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24415e080 msgr2=0x7fb2440ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24415e080 0x7fb2440ce670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 -- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb24406c710 msgr2=0x7fb244155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb24406c710 0x7fb244155280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 -- 172.21.15.106:0/2959645887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb23c009a70 con 0x7fb2440af4d0 2023-11-24T06:14:25.165 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24981d700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c4e0 tx=0x7fb24000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400052d0 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb240005430 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2441568c0 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2400038c0 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.159+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb244155d00 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.160+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2440753f0 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.161+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb240003a20 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.161+0000 7fb23affd700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 0x7fb22806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.161+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb240088b30 con 0x7fb2440af4d0 2023-11-24T06:14:25.166 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.162+0000 7fb24a01e700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 0x7fb22806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.162+0000 7fb24a01e700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 0x7fb22806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.166+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb240053b60 con 0x7fb2440af4d0 2023-11-24T06:14:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.398+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb244067f60 con 0x7fb2440af4d0 2023-11-24T06:14:25.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2023-11-24T06:14:25.399+0000 7f20eeb57700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:14:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.400+0000 7fb23affd700 1 -- 172.21.15.106:0/2959645887 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb240017090 con 0x7fb2440af4d0 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 msgr2=0x7fb22806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 0x7fb22806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb234007fd0 tx=0x7fb234009040 comp rx=0 tx=0).stop 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 msgr2=0x7fb2441557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c4e0 tx=0x7fb24000c8a0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 shutdown_connections 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb22806aed0 0x7fb22806d390 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb24415e080 0x7fb2440ce670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb24406c710 0x7fb244155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 --2- 172.21.15.106:0/2959645887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2440af4d0 0x7fb2441557c0 secure :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb24000c4e0 tx=0x7fb24000c8a0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 >> 172.21.15.106:0/2959645887 conn(0x7fb244071b90 msgr2=0x7fb24406bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 shutdown_connections 2023-11-24T06:14:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.403+0000 7fb24c282700 1 -- 172.21.15.106:0/2959645887 wait complete. 2023-11-24T06:14:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:14:25.418 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:14:25.446 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-24T06:14:25.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 Processor -- start 2023-11-24T06:14:25.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 -- start start 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe86c0b93c0 0x7fe86c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c0b6fb0 con 0x7fe86c15e320 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe86c0d2c10 con 0x7fe86c0b3250 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.538+0000 7fe87205c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe86c0d4da0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86b7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe86c15e320 0x7fe86c0d2400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39604/0 (socket says 172.21.15.106:39604) 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86b7fe700 1 -- 172.21.15.106:0/759314203 learned_addr learned my addr 172.21.15.106:0/759314203 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe862ffd700 1 --2- 172.21.15.106:0/759314203 >> v2:172.21.15.176:3300/0 conn(0x7fe86c0b93c0 0x7fe86c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86affd700 1 -- 172.21.15.106:0/759314203 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 158238673 0 0) 0x7fe86c0b6fb0 con 0x7fe86c15e320 2023-11-24T06:14:25.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86affd700 1 -- 172.21.15.106:0/759314203 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8580035b0 con 0x7fe86c15e320 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe862ffd700 1 -- 172.21.15.106:0/759314203 >> v1:172.21.15.176:6789/0 conn(0x7fe86c0b3250 legacy=0x7fe86c167d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe862ffd700 1 -- 172.21.15.106:0/759314203 >> v1:172.21.15.106:6789/0 conn(0x7fe86c15e320 legacy=0x7fe86c0d2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe862ffd700 1 -- 172.21.15.106:0/759314203 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c0d2ef0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe862ffd700 1 --2- 172.21.15.106:0/759314203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b93c0 0x7fe86c06aff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe854009840 tx=0x7fe854009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9b8d95a86e232a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86affd700 1 -- 172.21.15.106:0/759314203 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011830 con 0x7fe86c0b93c0 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86affd700 1 -- 172.21.15.106:0/759314203 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe854011990 con 0x7fe86c0b93c0 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.539+0000 7fe86affd700 1 -- 172.21.15.106:0/759314203 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854011d20 con 0x7fe86c0b93c0 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 -- 172.21.15.106:0/759314203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b93c0 msgr2=0x7fe86c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 --2- 172.21.15.106:0/759314203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b93c0 0x7fe86c06aff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe854009840 tx=0x7fe854009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:25.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 -- 172.21.15.106:0/759314203 shutdown_connections 2023-11-24T06:14:25.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 --2- 172.21.15.106:0/759314203 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b93c0 0x7fe86c06aff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 -- 172.21.15.106:0/759314203 >> 172.21.15.106:0/759314203 conn(0x7fe86c0d3e50 msgr2=0x7fe86c0d4260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:25.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 -- 172.21.15.106:0/759314203 shutdown_connections 2023-11-24T06:14:25.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.540+0000 7fe87205c700 1 -- 172.21.15.106:0/759314203 wait complete. 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.541+0000 7fe87205c700 1 Processor -- start 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.541+0000 7fe87205c700 1 -- start start 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b3250 0x7fe86c0c70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 0x7fe86c15f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c1493d0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c0cba30 con 0x7fe86c0b3250 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe87205c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c14bed0 con 0x7fe86c15e320 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59350/0 (socket says 172.21.15.106:59350) 2023-11-24T06:14:25.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 -- 172.21.15.106:0/1585409655 learned_addr learned my addr 172.21.15.106:0/1585409655 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe86b7fe700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b3250 0x7fe86c0c70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe86bfff700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 0x7fe86c15f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 -- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 msgr2=0x7fe86c15f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 0x7fe86c15f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 -- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b3250 msgr2=0x7fe86c0c70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b3250 0x7fe86c0c70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe862ffd700 1 -- 172.21.15.106:0/1585409655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8540094a0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.542+0000 7fe86bfff700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 0x7fe86c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe862ffd700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe854009fd0 tx=0x7fe854004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8540036a0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe85401f070 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe86c14b910 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe854003a20 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.543+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86c148ff0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.544+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe86c068fb0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.544+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe854003b80 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.545+0000 7fe868ff9700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 0x7fe84c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.545+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fe854021070 con 0x7fe86c0b93c0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.545+0000 7fe86b7fe700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 0x7fe84c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:25.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.545+0000 7fe86b7fe700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 0x7fe84c06d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c007dc0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:25.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.549+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe854055fb0 con 0x7fe86c0b93c0 2023-11-24T06:14:25.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:25.787+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe86c149510 con 0x7fe86c0b93c0 2023-11-24T06:14:26.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.406+0000 7fe868ff9700 1 -- 172.21.15.106:0/1585409655 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe86c149510 con 0x7fe86c0b93c0 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 msgr2=0x7fe84c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 0x7fe84c06d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fe85c007fd0 tx=0x7fe85c007dc0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 msgr2=0x7fe86c14af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe854009fd0 tx=0x7fe854004750 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 shutdown_connections 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe84c06aed0 0x7fe84c06d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe86c15e320 0x7fe86c15f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe86c0b3250 0x7fe86c0c70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 --2- 172.21.15.106:0/1585409655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe86c0b93c0 0x7fe86c14af50 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 >> 172.21.15.106:0/1585409655 conn(0x7fe86c0d3e50 msgr2=0x7fe86c0b4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 shutdown_connections 2023-11-24T06:14:26.413 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.409+0000 7fe87205c700 1 -- 172.21.15.106:0/1585409655 wait complete. 2023-11-24T06:14:26.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:14:26.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 Processor -- start 2023-11-24T06:14:26.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 -- start start 2023-11-24T06:14:26.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff26c0b01e0 0x7ff26c06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0b05c0 con 0x7ff26c0b59c0 2023-11-24T06:14:26.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0b4250 con 0x7ff26c0746a0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.553+0000 7ff272e33700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c1470a0 con 0x7ff26c0b01e0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff26c0b59c0 0x7ff26c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39620/0 (socket says 172.21.15.106:39620) 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 -- 172.21.15.106:0/1470919541 learned_addr learned my addr 172.21.15.106:0/1470919541 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315163361 0 0) 0x7ff26c0b05c0 con 0x7ff26c0b59c0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff270bcf700 1 --2- 172.21.15.106:0/1470919541 >> v2:172.21.15.176:3300/0 conn(0x7ff26c0b01e0 0x7ff26c06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff25c0035b0 con 0x7ff26c0b59c0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1797004333 0 0) 0x7ff25c0035b0 con 0x7ff26c0b59c0 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 >> v2:172.21.15.176:3300/0 conn(0x7ff26c0b01e0 msgr2=0x7ff26c06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 --2- 172.21.15.106:0/1470919541 >> v2:172.21.15.176:3300/0 conn(0x7ff26c0b01e0 0x7ff26c06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.560 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 >> v1:172.21.15.176:6789/0 conn(0x7ff26c0746a0 legacy=0x7ff26c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c06dc00 con 0x7ff26c0b59c0 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7ff258001670 con 0x7ff26c0b59c0 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 >> v1:172.21.15.106:6789/0 conn(0x7ff26c0b59c0 legacy=0x7ff26c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25c003a00 0x7ff25c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 0x7ff25c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c005210 0x7ff25c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c1470a0 con 0x7ff25c004850 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c00c1b0 con 0x7ff25c005210 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff25c00c370 con 0x7ff25c003a00 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 0x7ff25c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff2713d0700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c005210 0x7ff25c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff270bcf700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25c003a00 0x7ff25c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 -- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25c003a00 msgr2=0x7ff25c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff25c003a00 0x7ff25c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 -- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c005210 msgr2=0x7ff25c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.554+0000 7ff26bfff700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c005210 0x7ff25c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff2713d0700 1 -- 172.21.15.106:0/1470919541 reap_dead start 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff26bfff700 1 -- 172.21.15.106:0/1470919541 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c0035b0 con 0x7ff25c004850 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff26bfff700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 0x7ff25c004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c2a0 tx=0x7ff25c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21b5b1abb8a8ed0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258007c10 con 0x7ff25c004850 2023-11-24T06:14:26.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25800cdc0 con 0x7ff25c004850 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff26b7fe700 1 -- 172.21.15.106:0/1470919541 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258005ba0 con 0x7ff25c004850 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 -- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 msgr2=0x7ff25c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 0x7ff25c004cd0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c2a0 tx=0x7ff25c005880 comp rx=0 tx=0).stop 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 -- 172.21.15.106:0/1470919541 shutdown_connections 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 --2- 172.21.15.106:0/1470919541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff25c004850 0x7ff25c004cd0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 -- 172.21.15.106:0/1470919541 >> 172.21.15.106:0/1470919541 conn(0x7ff26c0d0b40 msgr2=0x7ff26c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 -- 172.21.15.106:0/1470919541 shutdown_connections 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.555+0000 7ff272e33700 1 -- 172.21.15.106:0/1470919541 wait complete. 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 Processor -- start 2023-11-24T06:14:26.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 -- start start 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c004850 0x7ff26c071e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff26c0c5b30 0x7ff26c0c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c7520 con 0x7ff26c0c8070 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c8a30 con 0x7ff25c004850 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.557+0000 7ff272e33700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c0c68a0 con 0x7ff26c0c5b30 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59370/0 (socket says 172.21.15.106:59370) 2023-11-24T06:14:26.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 -- 172.21.15.106:0/2505347749 learned_addr learned my addr 172.21.15.106:0/2505347749 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff2713d0700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff26c0c5b30 0x7ff26c0c5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 -- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff26c0c5b30 msgr2=0x7ff26c0c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff26c0c5b30 0x7ff26c0c5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 -- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c004850 msgr2=0x7ff26c071e30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c004850 0x7ff26c071e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 -- 172.21.15.106:0/2505347749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0c6b80 con 0x7ff26c0c8070 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff26bfff700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff258001930 tx=0x7ff26c0b0750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258000ed0 con 0x7ff26c0c8070 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2580070d0 con 0x7ff26c0c8070 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff258007460 con 0x7ff26c0c8070 2023-11-24T06:14:26.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c0c6e60 con 0x7ff26c0c8070 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.558+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c0c64d0 con 0x7ff26c0c8070 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.559+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c0c6660 con 0x7ff26c0c8070 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.560+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2580075c0 con 0x7ff26c0c8070 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.560+0000 7ff2697fa700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 0x7ff25006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.560+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff25808a620 con 0x7ff26c0c8070 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.560+0000 7ff270bcf700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 0x7ff25006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.560+0000 7ff270bcf700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 0x7ff25006d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff260009a30 tx=0x7ff260008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:26.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.565+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff26c0c6660 con 0x7ff26c0c8070 2023-11-24T06:14:26.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:26.757+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff26c0c6660 con 0x7ff26c0c8070 2023-11-24T06:14:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.407+0000 7ff2697fa700 1 -- 172.21.15.106:0/2505347749 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff26c0c6660 con 0x7ff26c0c8070 2023-11-24T06:14:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 msgr2=0x7ff25006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 0x7ff25006d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff260009a30 tx=0x7ff260008040 comp rx=0 tx=0).stop 2023-11-24T06:14:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 msgr2=0x7ff26c0c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff258001930 tx=0x7ff26c0b0750 comp rx=0 tx=0).stop 2023-11-24T06:14:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 shutdown_connections 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff25006aed0 0x7ff25006d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff26c0c5b30 0x7ff26c0c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff25c004850 0x7ff26c071e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 --2- 172.21.15.106:0/2505347749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff26c0c8070 0x7ff26c0c84f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 >> 172.21.15.106:0/2505347749 conn(0x7ff26c0d0b40 msgr2=0x7ff26c0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 shutdown_connections 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.411+0000 7ff272e33700 1 -- 172.21.15.106:0/2505347749 wait complete. 2023-11-24T06:14:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:14:27.429 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:14:27.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.556+0000 7f56b4873700 1 Processor -- start 2023-11-24T06:14:27.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.556+0000 7f56b4873700 1 -- start start 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f56b015dfa0 0x7f56b00cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56b00b1260 0x7f56b00ce480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b00d1b00 0x7f56b00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b00d2470 con 0x7f56b00b1260 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56b006b460 con 0x7f56b015dfa0 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56b4873700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00cee20 con 0x7f56b00d1b00 2023-11-24T06:14:27.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56b00b1260 0x7f56b00ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56b00b1260 0x7f56b00ce480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59376/0 (socket says 172.21.15.106:59376) 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 -- 172.21.15.106:0/2883233493 learned_addr learned my addr 172.21.15.106:0/2883233493 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 -- 172.21.15.106:0/2883233493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b00d1b00 msgr2=0x7f56b00d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 --2- 172.21.15.106:0/2883233493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b00d1b00 0x7f56b00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 -- 172.21.15.106:0/2883233493 >> v2:172.21.15.176:3300/0 conn(0x7f56b015dfa0 msgr2=0x7f56b00cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 --2- 172.21.15.106:0/2883233493 >> v2:172.21.15.176:3300/0 conn(0x7f56b015dfa0 0x7f56b00cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 -- 172.21.15.106:0/2883233493 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00cf100 con 0x7f56b00b1260 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56add9b700 1 --2- 172.21.15.106:0/2883233493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b00ce480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f56b00d2770 tx=0x7f56a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd88b6803f13537 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56ad59a700 1 -- 172.21.15.106:0/2883233493 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400b870 con 0x7f56b00b1260 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56ad59a700 1 -- 172.21.15.106:0/2883233493 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400b9d0 con 0x7f56b00b1260 2023-11-24T06:14:27.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.557+0000 7f56ad59a700 1 -- 172.21.15.106:0/2883233493 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400bd60 con 0x7f56b00b1260 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 -- 172.21.15.106:0/2883233493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 msgr2=0x7f56b00ce480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 --2- 172.21.15.106:0/2883233493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b00ce480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f56b00d2770 tx=0x7f56a4009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 -- 172.21.15.106:0/2883233493 shutdown_connections 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 --2- 172.21.15.106:0/2883233493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b00d1b00 0x7f56b00d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 --2- 172.21.15.106:0/2883233493 >> v2:172.21.15.176:3300/0 conn(0x7f56b015dfa0 0x7f56b00cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 --2- 172.21.15.106:0/2883233493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b00ce480 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 -- 172.21.15.106:0/2883233493 >> 172.21.15.106:0/2883233493 conn(0x7f56b009aa00 msgr2=0x7f56b009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 -- 172.21.15.106:0/2883233493 shutdown_connections 2023-11-24T06:14:27.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.558+0000 7f56b4873700 1 -- 172.21.15.106:0/2883233493 wait complete. 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.559+0000 7f56b4873700 1 Processor -- start 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.559+0000 7f56b4873700 1 -- start start 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56b00d1b00 0x7f56b0153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b015dfa0 0x7f56b0154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00b4a50 con 0x7f56b00b1260 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00b4c60 con 0x7f56b00d1b00 2023-11-24T06:14:27.566 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56b4873700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56b00b4f40 con 0x7f56b015dfa0 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59382/0 (socket says 172.21.15.106:59382) 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 -- 172.21.15.106:0/4049559010 learned_addr learned my addr 172.21.15.106:0/4049559010 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56add9b700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56b00d1b00 0x7f56b0153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56aed9d700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b015dfa0 0x7f56b0154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 -- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b015dfa0 msgr2=0x7f56b0154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b015dfa0 0x7f56b0154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 -- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56b00d1b00 msgr2=0x7f56b0153ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56b00d1b00 0x7f56b0153ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.560+0000 7f56ae59c700 1 -- 172.21.15.106:0/4049559010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a4009550 con 0x7f56b00b1260 2023-11-24T06:14:27.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f56ae59c700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b530 tx=0x7f56a000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0011830 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a00119b0 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b00b5220 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a0011d60 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.561+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b015eb60 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.562+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b0067f60 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.562+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56a001a400 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.563+0000 7f569effd700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.563+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f56a00895c0 con 0x7f56b00b1260 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.563+0000 7f56add9b700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.563+0000 7f56add9b700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56b00d2770 tx=0x7f56a4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:27.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.567+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f56a0054750 con 0x7f56b00b1260 2023-11-24T06:14:27.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:27.765+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f56b006cd00 con 0x7f56b00b1260 2023-11-24T06:14:28.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.409+0000 7f569effd700 1 -- 172.21.15.106:0/4049559010 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f56a00150d0 con 0x7f56b00b1260 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 msgr2=0x7f569006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f56b00d2770 tx=0x7f56a4008030 comp rx=0 tx=0).stop 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 msgr2=0x7f56b015a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f56a000b530 tx=0x7f56a000b8f0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 shutdown_connections 2023-11-24T06:14:28.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.412+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56b015dfa0 0x7f56b0154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56b00b1260 0x7f56b015a760 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 --2- 172.21.15.106:0/4049559010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56b00d1b00 0x7f56b0153ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 >> 172.21.15.106:0/4049559010 conn(0x7f56b009aa00 msgr2=0x7f56b00cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 shutdown_connections 2023-11-24T06:14:28.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.413+0000 7f56b4873700 1 -- 172.21.15.106:0/4049559010 wait complete. 2023-11-24T06:14:28.420 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2023-11-24T06:14:28.434 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-24T06:14:28.434 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-24T06:14:28.434 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:14:28.434 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:28.435 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-24T06:14:28.435 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-24T06:14:28.435 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:14:28.435 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:28.435 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-24T06:14:28.436 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-24T06:14:28.436 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:14:28.436 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:28.436 INFO:tasks.ceph.mds.d:Restarting daemon 2023-11-24T06:14:28.436 INFO:tasks.ceph.mds.d:Stopping old one... 2023-11-24T06:14:28.436 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:14:28.437 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:14:28.446 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:14:28.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-24T06:14:28.447 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:14:28.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-24T06:14:28.448 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:14:28.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-24T06:14:28.449 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:14:28.449 DEBUG:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-11-24T06:14:28.489 INFO:tasks.ceph.mds.c:Started 2023-11-24T06:14:28.489 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:28.490 INFO:tasks.ceph.mds.a:Started 2023-11-24T06:14:28.490 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:28.492 INFO:tasks.ceph.mds.b:Started 2023-11-24T06:14:28.492 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:28.493 INFO:tasks.ceph.mds.d:Started 2023-11-24T06:14:28.493 DEBUG:teuthology.parallel:result is None 2023-11-24T06:14:28.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-24T06:14:28.569 INFO:tasks.ceph.mds.c.smithi106.stdout:starting mds.c at 2023-11-24T06:14:28.570 INFO:tasks.ceph.mds.a.smithi106.stdout:starting mds.a at 2023-11-24T06:14:28.575 INFO:tasks.ceph.mds.d.smithi176.stdout:starting mds.d at 2023-11-24T06:14:28.575 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-24T06:14:28.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.620+0000 7f5464290700 1 Processor -- start 2023-11-24T06:14:28.623 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.620+0000 7f5464290700 1 -- start start 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.621+0000 7f5464290700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c1512b0 0x7f545c06d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.621+0000 7f5464290700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f545c0b4af0 0x7f545c06d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.621+0000 7f5464290700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c070ed0 con 0x7f545c151690 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.621+0000 7f5464290700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c15ad30 con 0x7f545c0b4af0 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.621+0000 7f5464290700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c06dc70 con 0x7f545c1512b0 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f545c0b4af0 0x7f545c06d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546182b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f545c151690 0x7f545c0b43e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39676/0 (socket says 172.21.15.106:39676) 2023-11-24T06:14:28.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546182b700 1 -- 172.21.15.106:0/2419662093 learned_addr learned my addr 172.21.15.106:0/2419662093 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546202c700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c1512b0 0x7f545c06d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 -- 172.21.15.106:0/2419662093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c1512b0 msgr2=0x7f545c06d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c1512b0 0x7f545c06d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 -- 172.21.15.106:0/2419662093 >> v1:172.21.15.106:6789/0 conn(0x7f545c151690 legacy=0x7f545c0b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546102a700 1 -- 172.21.15.106:0/2419662093 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507234972 0 0) 0x7f545c070ed0 con 0x7f545c151690 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 -- 172.21.15.106:0/2419662093 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c06df50 con 0x7f545c0b4af0 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546282d700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c0b4af0 0x7f545c06d640 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5454009d90 tx=0x7f545400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebd099ffe940635 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546102a700 1 -- 172.21.15.106:0/2419662093 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400bbd0 con 0x7f545c0b4af0 2023-11-24T06:14:28.627 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546102a700 1 -- 172.21.15.106:0/2419662093 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400bd30 con 0x7f545c0b4af0 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.622+0000 7f546102a700 1 -- 172.21.15.106:0/2419662093 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400bea0 con 0x7f545c0b4af0 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 -- 172.21.15.106:0/2419662093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c0b4af0 msgr2=0x7f545c06d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c0b4af0 0x7f545c06d640 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f5454009d90 tx=0x7f545400b330 comp rx=0 tx=0).stop 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 -- 172.21.15.106:0/2419662093 shutdown_connections 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c0b4af0 0x7f545c06d640 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 --2- 172.21.15.106:0/2419662093 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c1512b0 0x7f545c06d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 -- 172.21.15.106:0/2419662093 >> 172.21.15.106:0/2419662093 conn(0x7f545c0cfa30 msgr2=0x7f545c0cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 -- 172.21.15.106:0/2419662093 shutdown_connections 2023-11-24T06:14:28.628 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.623+0000 7f5464290700 1 -- 172.21.15.106:0/2419662093 wait complete. 2023-11-24T06:14:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.624+0000 7f5464290700 1 Processor -- start 2023-11-24T06:14:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.624+0000 7f5464290700 1 -- start start 2023-11-24T06:14:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0b4af0 0x7f545c151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 0x7f545c13bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0cda50 con 0x7f545c151690 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0cd420 con 0x7f545c1512b0 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5464290700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c13cec0 con 0x7f545c0b4af0 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59424/0 (socket says 172.21.15.106:59424) 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 -- 172.21.15.106:0/2876620655 learned_addr learned my addr 172.21.15.106:0/2876620655 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546202c700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0b4af0 0x7f545c151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546182b700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 0x7f545c13bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 -- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0b4af0 msgr2=0x7f545c151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0b4af0 0x7f545c151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 -- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 msgr2=0x7f545c13bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 0x7f545c13bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 -- 172.21.15.106:0/2876620655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009a70 con 0x7f545c151690 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546182b700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 0x7f545c13bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f546282d700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5454014000 tx=0x7f5454004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.625+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454020070 con 0x7f545c151690 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.626+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54540118a0 con 0x7f545c151690 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.626+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c154860 con 0x7f545c151690 2023-11-24T06:14:28.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.626+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5454011a50 con 0x7f545c151690 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.626+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c0cd670 con 0x7f545c151690 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.627+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c154d80 con 0x7f545c151690 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.627+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5454011bb0 con 0x7f545c151690 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.627+0000 7f5452ffd700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 0x7f544006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.627+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f545408bbb0 con 0x7f545c151690 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.627+0000 7f546202c700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 0x7f544006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:28.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.628+0000 7f546202c700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 0x7f544006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5458009930 tx=0x7f5458008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:28.635 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.632+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f545c154d80 con 0x7f545c151690 2023-11-24T06:14:28.650 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-11-24T06:14:28.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:28.836+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f545c154d80 con 0x7f545c151690 2023-11-24T06:14:29.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.425+0000 7f5452ffd700 1 -- 172.21.15.106:0/2876620655 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v27) v1 ==== 97+0+0 (secure 0 0 0) 0x7f545c154d80 con 0x7f545c151690 2023-11-24T06:14:29.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 msgr2=0x7f544006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 0x7f544006d390 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5458009930 tx=0x7f5458008040 comp rx=0 tx=0).stop 2023-11-24T06:14:29.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 msgr2=0x7f545c0cde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5454014000 tx=0x7f5454004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 shutdown_connections 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f544006aed0 0x7f544006d390 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f545c151690 0x7f545c0cde70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f545c0b4af0 0x7f545c151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 --2- 172.21.15.106:0/2876620655 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f545c1512b0 0x7f545c13bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 >> 172.21.15.106:0/2876620655 conn(0x7f545c0cfa30 msgr2=0x7f545c158570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 shutdown_connections 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.428+0000 7f5464290700 1 -- 172.21.15.106:0/2876620655 wait complete. 2023-11-24T06:14:29.432 INFO:teuthology.orchestra.run.smithi106.stderr: removed all blocklist entries 2023-11-24T06:14:29.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-24T06:14:29.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.564+0000 7f2689b75700 1 Processor -- start 2023-11-24T06:14:29.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.564+0000 7f2689b75700 1 -- start start 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2689b75700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 0x7f268406ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2689b75700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2684073f90 0x7f2684074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2689b75700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f268406e7f0 con 0x7f26840ce090 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2689b75700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2684074960 con 0x7f2684073f90 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2689b75700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268406dec0 con 0x7f268415e2a0 2023-11-24T06:14:29.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2682ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f26840ce090 0x7f268406ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39690/0 (socket says 172.21.15.106:39690) 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2682ffd700 1 -- 172.21.15.106:0/1899875600 learned_addr learned my addr 172.21.15.106:0/1899875600 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3963516084 0 0) 0x7f268406e7f0 con 0x7f26840ce090 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26700035b0 con 0x7f26840ce090 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.565+0000 7f2683fff700 1 --2- 172.21.15.106:0/1899875600 >> v2:172.21.15.176:3300/0 conn(0x7f2684073f90 0x7f2684074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3247581044 0 0) 0x7f26700035b0 con 0x7f26840ce090 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 msgr2=0x7f268406ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 0x7f268406ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 >> v2:172.21.15.176:3300/0 conn(0x7f2684073f90 msgr2=0x7f2684074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 --2- 172.21.15.106:0/1899875600 >> v2:172.21.15.176:3300/0 conn(0x7f2684073f90 0x7f2684074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268406e1a0 con 0x7f26840ce090 2023-11-24T06:14:29.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f2674001670 con 0x7f26840ce090 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 >> v1:172.21.15.106:6789/0 conn(0x7f26840ce090 legacy=0x7f268406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2670003a00 0x7f2670003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 0x7f2670004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670004d90 0x7f2670005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684074960 con 0x7f2670003a00 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268406dec0 con 0x7f2670004d90 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267000bbf0 con 0x7f268415e2a0 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2670003a00 0x7f2670003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f2682ffd700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 0x7f2670004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f2683fff700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670004d90 0x7f2670005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 -- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 msgr2=0x7f2670004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415e2a0 0x7f2670004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 -- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670004d90 msgr2=0x7f2670005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670004d90 0x7f2670005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 -- 172.21.15.106:0/1899875600 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700035b0 con 0x7f2670003a00 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f2683fff700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670004d90 0x7f2670005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26837fe700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2670003a00 0x7f2670003e20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f266c009910 tx=0x7f2670005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2984ea9904b4479 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c004230 con 0x7f2670003a00 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c0043b0 con 0x7f2670003a00 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.566+0000 7f26827fc700 1 -- 172.21.15.106:0/1899875600 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0038c0 con 0x7f2670003a00 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 -- 172.21.15.106:0/1899875600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2670003a00 msgr2=0x7f2670003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.574 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 --2- 172.21.15.106:0/1899875600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2670003a00 0x7f2670003e20 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f266c009910 tx=0x7f2670005880 comp rx=0 tx=0).stop 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2683fff700 1 -- 172.21.15.106:0/1899875600 reap_dead start 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 -- 172.21.15.106:0/1899875600 shutdown_connections 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 -- 172.21.15.106:0/1899875600 >> 172.21.15.106:0/1899875600 conn(0x7f26840cd570 msgr2=0x7f26840cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 -- 172.21.15.106:0/1899875600 shutdown_connections 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.567+0000 7f2689b75700 1 -- 172.21.15.106:0/1899875600 wait complete. 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.568+0000 7f2689b75700 1 Processor -- start 2023-11-24T06:14:29.575 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.568+0000 7f2689b75700 1 -- start start 2023-11-24T06:14:29.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 0x7f2684160430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415a750 0x7f2684153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268415ffa0 con 0x7f26841596c0 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268415f390 con 0x7f2670003a00 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2689b75700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268415f670 con 0x7f268415a750 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2682ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59442/0 (socket says 172.21.15.106:59442) 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2682ffd700 1 -- 172.21.15.106:0/1195769425 learned_addr learned my addr 172.21.15.106:0/1195769425 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f26837fe700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 0x7f2684160430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.569+0000 7f2683fff700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415a750 0x7f2684153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 -- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415a750 msgr2=0x7f2684153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415a750 0x7f2684153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 -- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 msgr2=0x7f2684160430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 0x7f2684160430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 -- 172.21.15.106:0/1195769425 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f268415f950 con 0x7f26841596c0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f26837fe700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 0x7f2684160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2682ffd700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f267400e810 tx=0x7f267400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400c5f0 con 0x7f26841596c0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267400c750 con 0x7f26841596c0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f268415fc30 con 0x7f26841596c0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267400cb00 con 0x7f26841596c0 2023-11-24T06:14:29.579 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.570+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f268415abe0 con 0x7f26841596c0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.571+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f268415ae00 con 0x7f26841596c0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.571+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f267400cc60 con 0x7f26841596c0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.572+0000 7f267bfff700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 0x7f266406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.572+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f26740890a0 con 0x7f26841596c0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.572+0000 7f26837fe700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 0x7f266406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.572+0000 7f26837fe700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 0x7f266406d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f266c013040 tx=0x7f266c008070 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.580 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.576+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2674054530 con 0x7f26841596c0 2023-11-24T06:14:29.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.844+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f26841600e0 con 0x7f26841596c0 2023-11-24T06:14:29.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.845+0000 7f267bfff700 1 -- 172.21.15.106:0/1195769425 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f26841600e0 con 0x7f26841596c0 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "auth_dump": [ 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.a", 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlt8t5CxAAsvvmmcQD7gLh9PEmcinoEA==", 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.848 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.b", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlhn3qFxAAfWFcELOaPQBOtNSrzPoabw==", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.849 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.c", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBl1NO2EhAAh06zuJZauDPLQrKzwsc+ew==", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-11-24T06:14:29.850 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mds.d", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlrTFZHxAAGAV4/3mV7dqHWV92YVEfkw==", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-11-24T06:14:29.851 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.0", 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDePmBlOlNdBRAA3H7OBSFohwL5UPHleUl5vw==", 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.1", 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDhPmBlnOQJBRAAhaPa6HE8ThfnO/Ao8OOiUw==", 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.2", 2023-11-24T06:14:29.853 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDkPmBlbADzBBAAKTNN/gFKWZs+VvylbkiB3A==", 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.3", 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDnPmBlfGPWBBAAdnF/Co8TQLowHlP6MPOliQ==", 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.854 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.4", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDtPmBl1nhnBxAA7Ms+mPk6u7pqldgKBscprg==", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.5", 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDwPmBljHCMBxAAfqqAbkAR78yC5j+PDMYY0Q==", 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.856 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.6", 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDzPmBlB4oZBxAAz9PFkRRMtGrdcnBYv49dhw==", 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "osd.7", 2023-11-24T06:14:29.857 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD2PmBldvxkBhAAoQ3K/6MWEA5XX5X+9o91WQ==", 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow profile osd", 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile osd", 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.0", 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBl1j6aIxAAAR3xrON0w7ObmiN+s8p//g==", 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.858 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.1", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlb3mhLBAAhqVrreYNSyUEzuIP+KQm6g==", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-11-24T06:14:29.859 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.2", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlgkRKKRAAWymetPQcPFSHayaC1PK0Fw==", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-11-24T06:14:29.860 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.3", 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBl5fBXMhAAJBt2jDg/VodHWrgU6bT5fA==", 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow", 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow r", 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow rw", 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow rwx" 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.admin", 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDZPmBlhVsRKRAAG4c2a1qeLIUhQz12y545IA==", 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": "allow *", 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow *", 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mds", 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBlniMMBhAAI1tTCk9G1xV+/rNw3pAfQQ==", 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mds" 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-mgr", 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBlBi0MBhAA29D0AEUYMQU93+LuhaCVJw==", 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-24T06:14:29.863 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-osd", 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBlfDQMBhAAt78HXvTDTtyfHdiC7T8JlA==", 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-osd" 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd", 2023-11-24T06:14:29.864 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBl4TwMBhAAKe6mBZbLpfWtYVe8bhA1QA==", 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBlIkQMBhAAKR+o3pIr3dAOja1HKnUkzw==", 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "client.bootstrap-rgw", 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQD8PmBlmksMBhAAy1gTjM3awPuEeC3/HK9X8w==", 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.x", 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlaWsUCBAAsg3GesP5+XVbRRpO7U57Yw==", 2023-11-24T06:14:29.866 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "entity": "mgr.y", 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "key": "AQDaPmBlgRcbAxAAlnlh3rugVA6TjApKAw+bIg==", 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "caps": { 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mds": "allow *", 2023-11-24T06:14:29.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": "allow profile mgr", 2023-11-24T06:14:29.868 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": "allow *" 2023-11-24T06:14:29.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:29.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:14:29.868 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:14:29.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 msgr2=0x7f266406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 0x7f266406d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f266c013040 tx=0x7f266c008070 comp rx=0 tx=0).stop 2023-11-24T06:14:29.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 msgr2=0x7f2684161110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f267400e810 tx=0x7f267400ebd0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 shutdown_connections 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f266406aed0 0x7f266406d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f268415a750 0x7f2684153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2670003a00 0x7f2684160430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 --2- 172.21.15.106:0/1195769425 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26841596c0 0x7f2684161110 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 >> 172.21.15.106:0/1195769425 conn(0x7f26840cd570 msgr2=0x7f2684072300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 shutdown_connections 2023-11-24T06:14:29.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.847+0000 7f2689b75700 1 -- 172.21.15.106:0/1195769425 wait complete. 2023-11-24T06:14:29.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-24T06:14:29.992 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.990+0000 7f7ae5c91700 1 Processor -- start 2023-11-24T06:14:29.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.990+0000 7f7ae5c91700 1 -- start start 2023-11-24T06:14:29.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7ae5c91700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 0x7f7ae00b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7ae5c91700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7ae00adf00 0x7f7ae006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7ae5c91700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ae00af950 con 0x7f7ae006c540 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7ae5c91700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae006c9f0 con 0x7f7ae00adf00 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7ae5c91700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae0144a80 con 0x7f7ae01446a0 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7adeffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7ae00adf00 0x7f7ae006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7adffff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7ae006c540 0x7f7ae006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39714/0 (socket says 172.21.15.106:39714) 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7adffff700 1 -- 172.21.15.106:0/2303465885 learned_addr learned my addr 172.21.15.106:0/2303465885 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.991+0000 7f7adf7fe700 1 --2- 172.21.15.106:0/2303465885 >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 0x7f7ae00b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adeffd700 1 -- 172.21.15.106:0/2303465885 >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 msgr2=0x7f7ae00b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adeffd700 1 --2- 172.21.15.106:0/2303465885 >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 0x7f7ae00b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adeffd700 1 -- 172.21.15.106:0/2303465885 >> v1:172.21.15.106:6789/0 conn(0x7f7ae006c540 legacy=0x7f7ae006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adeffd700 1 -- 172.21.15.106:0/2303465885 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00afc30 con 0x7f7ae00adf00 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ade7fc700 1 -- 172.21.15.106:0/2303465885 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829630552 0 0) 0x7f7ae00af950 con 0x7f7ae006c540 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adf7fe700 1 --2- 172.21.15.106:0/2303465885 >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 0x7f7ae00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7adeffd700 1 --2- 172.21.15.106:0/2303465885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae006c000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00729a0 tx=0x7f7ad0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80ee396d2c7df3b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ade7fc700 1 -- 172.21.15.106:0/2303465885 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011830 con 0x7f7ae00adf00 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ade7fc700 1 -- 172.21.15.106:0/2303465885 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0011990 con 0x7f7ae00adf00 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ade7fc700 1 -- 172.21.15.106:0/2303465885 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0011d20 con 0x7f7ae00adf00 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 -- 172.21.15.106:0/2303465885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 msgr2=0x7f7ae006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/2303465885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae006c000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7ae00729a0 tx=0x7f7ad0009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 -- 172.21.15.106:0/2303465885 shutdown_connections 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/2303465885 >> v2:172.21.15.176:3300/0 conn(0x7f7ae01446a0 0x7f7ae00b5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/2303465885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae006c000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:29.997 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.992+0000 7f7ae5c91700 1 -- 172.21.15.106:0/2303465885 >> 172.21.15.106:0/2303465885 conn(0x7f7ae0071b90 msgr2=0x7f7ae0071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:29.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.993+0000 7f7ae5c91700 1 -- 172.21.15.106:0/2303465885 shutdown_connections 2023-11-24T06:14:29.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.993+0000 7f7ae5c91700 1 -- 172.21.15.106:0/2303465885 wait complete. 2023-11-24T06:14:30.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.994+0000 7f7ae5c91700 1 Processor -- start 2023-11-24T06:14:30.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.994+0000 7f7ae5c91700 1 -- start start 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae006c540 0x7f7ae01374a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae01446a0 0x7f7ae013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae013b190 con 0x7f7ae00adf00 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae013b3a0 con 0x7f7ae01446a0 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7ae5c91700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00cffc0 con 0x7f7ae006c540 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59454/0 (socket says 172.21.15.106:59454) 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 -- 172.21.15.106:0/1384352004 learned_addr learned my addr 172.21.15.106:0/1384352004 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adffff700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae01446a0 0x7f7ae013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adf7fe700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae006c540 0x7f7ae01374a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 -- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae006c540 msgr2=0x7f7ae01374a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae006c540 0x7f7ae01374a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 -- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae01446a0 msgr2=0x7f7ae013f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.995+0000 7f7adeffd700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae01446a0 0x7f7ae013f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7adeffd700 1 -- 172.21.15.106:0/1384352004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00094a0 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7adeffd700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00097c0 tx=0x7f7ad0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00038a0 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad001f070 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00d02a0 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0003c40 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.996+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae01408c0 con 0x7f7ae00adf00 2023-11-24T06:14:30.002 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.997+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae00753f0 con 0x7f7ae00adf00 2023-11-24T06:14:30.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.997+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ad0026480 con 0x7f7ae00adf00 2023-11-24T06:14:30.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.998+0000 7f7ac7fff700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.998+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ad0021070 con 0x7f7ae00adf00 2023-11-24T06:14:30.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.998+0000 7f7adf7fe700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.003 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:29.998+0000 7f7adf7fe700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 0x7f7acc06d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d8b0 tx=0x7f7ad4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.004 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.002+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ad0056080 con 0x7f7ae00adf00 2023-11-24T06:14:30.274 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.271+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7ae00cfe20 con 0x7f7ae00adf00 2023-11-24T06:14:30.275 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.273+0000 7f7ac7fff700 1 -- 172.21.15.106:0/1384352004 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7ae00cfe20 con 0x7f7ae00adf00 2023-11-24T06:14:30.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 msgr2=0x7f7acc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.278 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 0x7f7acc06d390 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d8b0 tx=0x7f7ad4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 msgr2=0x7f7ae01562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7ad00097c0 tx=0x7f7ad0004750 comp rx=0 tx=0).stop 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 shutdown_connections 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f7acc06aed0 0x7f7acc06d390 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7ae01446a0 0x7f7ae013f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7ae006c540 0x7f7ae01374a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.279 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 --2- 172.21.15.106:0/1384352004 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7ae00adf00 0x7f7ae01562a0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 >> 172.21.15.106:0/1384352004 conn(0x7f7ae0071b90 msgr2=0x7f7ae006da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 shutdown_connections 2023-11-24T06:14:30.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.275+0000 7f7ae5c91700 1 -- 172.21.15.106:0/1384352004 wait complete. 2023-11-24T06:14:30.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-24T06:14:30.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.408+0000 7f83c7a2f700 1 Processor -- start 2023-11-24T06:14:30.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.408+0000 7f83c7a2f700 1 -- start start 2023-11-24T06:14:30.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c7a2f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83c015e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c7a2f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c01414c0 con 0x7f83c00ce140 2023-11-24T06:14:30.414 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c7a2f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83c00ce9f0 con 0x7f83c015f630 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c7a2f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c015c300 con 0x7f83c015af10 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c4fca700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f83c00ce140 0x7f83c015ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39724/0 (socket says 172.21.15.106:39724) 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c4fca700 1 -- 172.21.15.106:0/3770751456 learned_addr learned my addr 172.21.15.106:0/3770751456 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c57cb700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83c015e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3666378773 0 0) 0x7f83c01414c0 con 0x7f83c00ce140 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83ac0035b0 con 0x7f83c00ce140 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1477750188 0 0) 0x7f83ac0035b0 con 0x7f83c00ce140 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 msgr2=0x7f83c015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83c015e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 >> v1:172.21.15.176:6789/0 conn(0x7f83c015f630 legacy=0x7f83c006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c00cecd0 con 0x7f83c00ce140 2023-11-24T06:14:30.415 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f83b0001670 con 0x7f83c00ce140 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 >> v1:172.21.15.106:6789/0 conn(0x7f83c00ce140 legacy=0x7f83c015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac003a30 0x7f83ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83ac004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83ac004d90 0x7f83ac005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c015c300 con 0x7f83ac004d90 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac00bac0 con 0x7f83ac003a30 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ac00bc80 con 0x7f83c015af10 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.409+0000 7f83c5fcc700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83ac004d90 0x7f83ac005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c57cb700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac003a30 0x7f83ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c4fca700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83ac004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 -- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 msgr2=0x7f83ac004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c015af10 0x7f83ac004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.416 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 -- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac003a30 msgr2=0x7f83ac003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83ac003a30 0x7f83ac003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 -- 172.21.15.106:0/3770751456 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ac0035b0 con 0x7f83ac004d90 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83c5fcc700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83ac004d90 0x7f83ac005210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f83b800e580 tx=0x7f83ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f01c6455f2184e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8001f00 con 0x7f83ac004d90 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8011690 con 0x7f83ac004d90 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.410+0000 7f83b7fff700 1 -- 172.21.15.106:0/3770751456 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8011a40 con 0x7f83ac004d90 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 -- 172.21.15.106:0/3770751456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83ac004d90 msgr2=0x7f83ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/3770751456 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83ac004d90 0x7f83ac005210 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f83b800e580 tx=0x7f83ac005880 comp rx=0 tx=0).stop 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c5fcc700 1 -- 172.21.15.106:0/3770751456 reap_dead start 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 -- 172.21.15.106:0/3770751456 shutdown_connections 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 -- 172.21.15.106:0/3770751456 >> 172.21.15.106:0/3770751456 conn(0x7f83c00cd570 msgr2=0x7f83c00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 -- 172.21.15.106:0/3770751456 shutdown_connections 2023-11-24T06:14:30.417 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.411+0000 7f83c7a2f700 1 -- 172.21.15.106:0/3770751456 wait complete. 2023-11-24T06:14:30.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.412+0000 7f83c7a2f700 1 Processor -- start 2023-11-24T06:14:30.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.412+0000 7f83c7a2f700 1 -- start start 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00ccc50 0x7f83c015c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c015ca60 0x7f83c015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01f3260 con 0x7f83c0156490 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01f3b00 con 0x7f83c015ca60 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0156870 con 0x7f83c00ccc50 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59474/0 (socket says 172.21.15.106:59474) 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 -- 172.21.15.106:0/1527672281 learned_addr learned my addr 172.21.15.106:0/1527672281 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c5fcc700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c015ca60 0x7f83c015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c4fca700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00ccc50 0x7f83c015c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 -- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00ccc50 msgr2=0x7f83c015c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00ccc50 0x7f83c015c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 -- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c015ca60 msgr2=0x7f83c015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c015ca60 0x7f83c015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 -- 172.21.15.106:0/1527672281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c015d450 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c57cb700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83bc011ad0 tx=0x7f83bc011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00f860 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc00f9c0 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c00cd0e0 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.413+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00fd70 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.414+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c01f3790 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.414+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c01f3de0 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.415+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f83bc014440 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.415+0000 7f83b5ffb700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 0x7f83a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.415+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f83bc089960 con 0x7f83c0156490 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.415+0000 7f83c4fca700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 0x7f83a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.416+0000 7f83c4fca700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 0x7f83a406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b4600 tx=0x7f83b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.420+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f83bc054d80 con 0x7f83c0156490 2023-11-24T06:14:30.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.690+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f83c00d07c0 con 0x7f83c0156490 2023-11-24T06:14:30.694 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.692+0000 7f83b5ffb700 1 -- 172.21.15.106:0/1527672281 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f83bc0583a0 con 0x7f83c0156490 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 msgr2=0x7f83a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 0x7f83a406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f83c00b4600 tx=0x7f83b0009040 comp rx=0 tx=0).stop 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 msgr2=0x7f83c00b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f83bc011ad0 tx=0x7f83bc011de0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 shutdown_connections 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f83a406aed0 0x7f83a406d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f83c015ca60 0x7f83c015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83c0156490 0x7f83c00b5260 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 --2- 172.21.15.106:0/1527672281 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f83c00ccc50 0x7f83c015c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 >> 172.21.15.106:0/1527672281 conn(0x7f83c00cd570 msgr2=0x7f83c006ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 shutdown_connections 2023-11-24T06:14:30.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.694+0000 7f83c7a2f700 1 -- 172.21.15.106:0/1527672281 wait complete. 2023-11-24T06:14:30.709 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-24T06:14:30.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.827+0000 7f2c4e0ff700 1 Processor -- start 2023-11-24T06:14:30.830 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.827+0000 7f2c4e0ff700 1 -- start start 2023-11-24T06:14:30.832 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c4e0ff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c4806c710 0x7f2c480cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c4e0ff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c480b49a0 0x7f2c480d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c4e0ff700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480d09a0 con 0x7f2c48152cc0 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c4e0ff700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4815c4b0 con 0x7f2c480b49a0 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c4e0ff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4815c790 con 0x7f2c4806c710 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c47fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2c480b49a0 0x7f2c480d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c477fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2c48152cc0 0x7f2c4806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39748/0 (socket says 172.21.15.106:39748) 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.828+0000 7f2c477fe700 1 -- 172.21.15.106:0/3532577184 learned_addr learned my addr 172.21.15.106:0/3532577184 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c46ffd700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c4806c710 0x7f2c480cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c47fff700 1 -- 172.21.15.106:0/3532577184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c4806c710 msgr2=0x7f2c480cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:30.833 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c47fff700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c4806c710 0x7f2c480cff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c47fff700 1 -- 172.21.15.106:0/3532577184 >> v1:172.21.15.106:6789/0 conn(0x7f2c48152cc0 legacy=0x7f2c4806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c47fff700 1 -- 172.21.15.106:0/3532577184 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4815ca70 con 0x7f2c480b49a0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c467fc700 1 -- 172.21.15.106:0/3532577184 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057815194 0 0) 0x7f2c480d09a0 con 0x7f2c48152cc0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c47fff700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c480b49a0 0x7f2c480d0460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009d90 tx=0x7f2c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da64a16e9fcf8c7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c467fc700 1 -- 172.21.15.106:0/3532577184 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4000e070 con 0x7f2c480b49a0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c467fc700 1 -- 172.21.15.106:0/3532577184 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4000bbd0 con 0x7f2c480b49a0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c467fc700 1 -- 172.21.15.106:0/3532577184 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40012430 con 0x7f2c480b49a0 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/3532577184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c480b49a0 msgr2=0x7f2c480d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c480b49a0 0x7f2c480d0460 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009d90 tx=0x7f2c4000b330 comp rx=0 tx=0).stop 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/3532577184 shutdown_connections 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c480b49a0 0x7f2c480d0460 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.834 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/3532577184 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c4806c710 0x7f2c480cff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.829+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/3532577184 >> 172.21.15.106:0/3532577184 conn(0x7f2c48071b90 msgr2=0x7f2c48071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:30.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.830+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/3532577184 shutdown_connections 2023-11-24T06:14:30.835 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.830+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/3532577184 wait complete. 2023-11-24T06:14:30.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.831+0000 7f2c4e0ff700 1 Processor -- start 2023-11-24T06:14:30.837 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.831+0000 7f2c4e0ff700 1 -- start start 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 0x7f2c48148500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 0x7f2c4815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481f74c0 con 0x7f2c4806c710 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4809c0c0 con 0x7f2c480b49a0 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c481f76d0 con 0x7f2c48152cc0 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59492/0 (socket says 172.21.15.106:59492) 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 -- 172.21.15.106:0/60832233 learned_addr learned my addr 172.21.15.106:0/60832233 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:30.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c47fff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 0x7f2c4815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c46ffd700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 0x7f2c48148500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 -- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 msgr2=0x7f2c4815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 0x7f2c4815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 -- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 msgr2=0x7f2c48148500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 0x7f2c48148500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 -- 172.21.15.106:0/60832233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009a70 con 0x7f2c4806c710 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c47fff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 0x7f2c4815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c46ffd700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 0x7f2c48148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c477fe700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c550 tx=0x7f2c3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c004c80 con 0x7f2c4806c710 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c3c004e00 con 0x7f2c4806c710 2023-11-24T06:14:30.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c481f79b0 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c007310 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.832+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c481f7f70 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.833+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c48150940 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.834+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2c3c007470 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.834+0000 7f2c2ffff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 0x7f2c3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.834+0000 7f2c46ffd700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 0x7f2c3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.834+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2c3c088fa0 con 0x7f2c4806c710 2023-11-24T06:14:30.840 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.835+0000 7f2c46ffd700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 0x7f2c3406d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2c48074fa0 tx=0x7f2c38008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:30.841 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:30.839+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2c3c0bbe90 con 0x7f2c4806c710 2023-11-24T06:14:31.111 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.109+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2c480753f0 con 0x7f2c4806c710 2023-11-24T06:14:31.113 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.111+0000 7f2c2ffff700 1 -- 172.21.15.106:0/60832233 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c3c0543a0 con 0x7f2c4806c710 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 msgr2=0x7f2c3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 0x7f2c3406d390 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2c48074fa0 tx=0x7f2c38008040 comp rx=0 tx=0).stop 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 msgr2=0x7f2c4809bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c00c550 tx=0x7f2c3c00c910 comp rx=0 tx=0).stop 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 shutdown_connections 2023-11-24T06:14:31.116 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2c3406aed0 0x7f2c3406d390 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2c48152cc0 0x7f2c4815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4806c710 0x7f2c4809bb80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 --2- 172.21.15.106:0/60832233 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2c480b49a0 0x7f2c48148500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 >> 172.21.15.106:0/60832233 conn(0x7f2c48071b90 msgr2=0x7f2c4806c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 shutdown_connections 2023-11-24T06:14:31.117 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.113+0000 7f2c4e0ff700 1 -- 172.21.15.106:0/60832233 wait complete. 2023-11-24T06:14:31.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.245+0000 7fa3e8c46700 1 Processor -- start 2023-11-24T06:14:31.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.245+0000 7fa3e8c46700 1 -- start start 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.246+0000 7fa3e8c46700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa3e40adf00 0x7fa3e406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.246+0000 7fa3e8c46700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e40af950 con 0x7fa3e406c540 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.246+0000 7fa3e8c46700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e40afc30 con 0x7fa3e41446a0 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.246+0000 7fa3e8c46700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e406c9f0 con 0x7fa3e40adf00 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e2d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa3e406c540 0x7fa3e40b3d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39766/0 (socket says 172.21.15.106:39766) 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/4109021193 learned_addr learned my addr 172.21.15.106:0/4109021193 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e1d9b700 1 --2- 172.21.15.106:0/4109021193 >> v2:172.21.15.176:3300/0 conn(0x7fa3e40adf00 0x7fa3e406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957796103 0 0) 0x7fa3e40af950 con 0x7fa3e406c540 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3cc0035b0 con 0x7fa3e406c540 2023-11-24T06:14:31.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362217480 0 0) 0x7fa3cc0035b0 con 0x7fa3e406c540 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 >> v2:172.21.15.176:3300/0 conn(0x7fa3e40adf00 msgr2=0x7fa3e406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 --2- 172.21.15.106:0/4109021193 >> v2:172.21.15.176:3300/0 conn(0x7fa3e40adf00 0x7fa3e406c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 >> v1:172.21.15.176:6789/0 conn(0x7fa3e41446a0 legacy=0x7fa3e40b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e40aff10 con 0x7fa3e406c540 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fa3dc0019f0 con 0x7fa3e406c540 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 >> v1:172.21.15.106:6789/0 conn(0x7fa3e406c540 legacy=0x7fa3e40b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 0x7fa3cc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3cc004850 0x7fa3cc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc005210 0x7fa3cc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e406c9f0 con 0x7fa3cc003a00 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc00c0b0 con 0x7fa3cc004850 2023-11-24T06:14:31.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc00c270 con 0x7fa3cc005210 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 0x7fa3cc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e1d9b700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3cc004850 0x7fa3cc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e2d9d700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc005210 0x7fa3cc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 -- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc005210 msgr2=0x7fa3cc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc005210 0x7fa3cc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 -- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3cc004850 msgr2=0x7fa3cc004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3cc004850 0x7fa3cc004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/4109021193 reap_dead start 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.247+0000 7fa3e259c700 1 -- 172.21.15.106:0/4109021193 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0035b0 con 0x7fa3cc003a00 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e259c700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 0x7fa3cc003e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80017c0 tx=0x7fa3cc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1c844415eff9c server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80052d0 con 0x7fa3cc003a00 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d8005430 con 0x7fa3cc003a00 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e159a700 1 -- 172.21.15.106:0/4109021193 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d80038c0 con 0x7fa3cc003a00 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 -- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 msgr2=0x7fa3cc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 0x7fa3cc003e20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa3d80017c0 tx=0x7fa3cc005880 comp rx=0 tx=0).stop 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 -- 172.21.15.106:0/4109021193 shutdown_connections 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/4109021193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3cc003a00 0x7fa3cc003e20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 -- 172.21.15.106:0/4109021193 >> 172.21.15.106:0/4109021193 conn(0x7fa3e4071b90 msgr2=0x7fa3e4071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 -- 172.21.15.106:0/4109021193 shutdown_connections 2023-11-24T06:14:31.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.248+0000 7fa3e8c46700 1 -- 172.21.15.106:0/4109021193 wait complete. 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.250+0000 7fa3e8c46700 1 Processor -- start 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.250+0000 7fa3e8c46700 1 -- start start 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc003a00 0x7fa3e41404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e41ef9f0 0x7fa3e4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e41417d0 con 0x7fa3e41efe70 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e406e600 con 0x7fa3e41ef9f0 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e8c46700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4140b50 con 0x7fa3cc003a00 2023-11-24T06:14:31.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e259c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc003a00 0x7fa3e41404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59516/0 (socket says 172.21.15.106:59516) 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/2381355311 learned_addr learned my addr 172.21.15.106:0/2381355311 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e1d9b700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e41ef9f0 0x7fa3e4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc003a00 msgr2=0x7fa3e41404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc003a00 0x7fa3e41404c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e41ef9f0 msgr2=0x7fa3e4073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e41ef9f0 0x7fa3e4073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.251+0000 7fa3e2d9d700 1 -- 172.21.15.106:0/2381355311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4140e30 con 0x7fa3e41efe70 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3e2d9d700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa3e409f000 tx=0x7fa3dc007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00ebd0 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc00ed30 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e4141110 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc013660 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.252+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e4141bf0 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.253+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e40753f0 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.253+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3dc0137c0 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.254+0000 7fa3d2ffd700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 0x7fa3c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.254+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa3dc0896f0 con 0x7fa3e41efe70 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.254+0000 7fa3e259c700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 0x7fa3c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.254+0000 7fa3e259c700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 0x7fa3c406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005040 tx=0x7fa3d8009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.258+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa3dc054b80 con 0x7fa3e41efe70 2023-11-24T06:14:31.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.530+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa3e4141910 con 0x7fa3e41efe70 2023-11-24T06:14:31.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.532+0000 7fa3d2ffd700 1 -- 172.21.15.106:0/2381355311 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa3e4141910 con 0x7fa3e41efe70 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 msgr2=0x7fa3c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 0x7fa3c406d390 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8005040 tx=0x7fa3d8009030 comp rx=0 tx=0).stop 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 msgr2=0x7fa3e40744d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa3e409f000 tx=0x7fa3dc007c90 comp rx=0 tx=0).stop 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 shutdown_connections 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa3c406aed0 0x7fa3c406d390 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3e41efe70 0x7fa3e40744d0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa3cc003a00 0x7fa3e41404c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 --2- 172.21.15.106:0/2381355311 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa3e41ef9f0 0x7fa3e4073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 >> 172.21.15.106:0/2381355311 conn(0x7fa3e4071b90 msgr2=0x7fa3e4071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:31.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 shutdown_connections 2023-11-24T06:14:31.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.534+0000 7fa3e8c46700 1 -- 172.21.15.106:0/2381355311 wait complete. 2023-11-24T06:14:31.549 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-24T06:14:31.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.667+0000 7f0901437700 1 Processor -- start 2023-11-24T06:14:31.670 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.667+0000 7f0901437700 1 -- start start 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f0901437700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f08fc15e1e0 0x7f08fc0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f0901437700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0d20b0 con 0x7f08fc0d3a00 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f0901437700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08fc0d2390 con 0x7f08fc0d0f80 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f0901437700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08fc0d3150 con 0x7f08fc15e1e0 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08fa7fc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f08fc0d3a00 0x7f08fc0d0870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39784/0 (socket says 172.21.15.106:39784) 2023-11-24T06:14:31.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08fa7fc700 1 -- 172.21.15.106:0/839680085 learned_addr learned my addr 172.21.15.106:0/839680085 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08faffd700 1 --2- 172.21.15.106:0/839680085 >> v2:172.21.15.176:3300/0 conn(0x7f08fc15e1e0 0x7f08fc0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202658117 0 0) 0x7f08fc0d20b0 con 0x7f08fc0d3a00 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e40035b0 con 0x7f08fc0d3a00 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3459010688 0 0) 0x7f08e40035b0 con 0x7f08fc0d3a00 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 >> v2:172.21.15.176:3300/0 conn(0x7f08fc15e1e0 msgr2=0x7f08fc0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 --2- 172.21.15.106:0/839680085 >> v2:172.21.15.176:3300/0 conn(0x7f08fc15e1e0 0x7f08fc0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 >> v1:172.21.15.176:6789/0 conn(0x7f08fc0d0f80 legacy=0x7f08fc0b6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0d2670 con 0x7f08fc0d3a00 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f08ec001670 con 0x7f08fc0d3a00 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 >> v1:172.21.15.106:6789/0 conn(0x7f08fc0d3a00 legacy=0x7f08fc0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e4003a00 0x7f08e4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.674 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4004850 0x7f08e4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 0x7f08e400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0d3150 con 0x7f08e4005210 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e400c0c0 con 0x7f08e4003a00 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.668+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e400c280 con 0x7f08e4004850 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08faffd700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e4003a00 0x7f08e4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 0x7f08e400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fa7fc700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4004850 0x7f08e4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 -- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4004850 msgr2=0x7f08e4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4004850 0x7f08e4004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 -- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e4003a00 msgr2=0x7f08e4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08e4003a00 0x7f08e4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 -- 172.21.15.106:0/839680085 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40035b0 con 0x7f08e4005210 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fa7fc700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4004850 0x7f08e4004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:31.675 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 -- 172.21.15.106:0/839680085 reap_dead start 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08fb7fe700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 0x7f08e400ba10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c160 tx=0x7f08e4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed3e323767e99e0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4001db0 con 0x7f08e4005210 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400ccc0 con 0x7f08e4005210 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.669+0000 7f08f9ffb700 1 -- 172.21.15.106:0/839680085 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4003c40 con 0x7f08e4005210 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 -- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 msgr2=0x7f08e400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 0x7f08e400ba10 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f08f400c160 tx=0x7f08e4005880 comp rx=0 tx=0).stop 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 -- 172.21.15.106:0/839680085 shutdown_connections 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 --2- 172.21.15.106:0/839680085 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08e4005210 0x7f08e400ba10 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 -- 172.21.15.106:0/839680085 >> 172.21.15.106:0/839680085 conn(0x7f08fc0b5b50 msgr2=0x7f08fc0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 -- 172.21.15.106:0/839680085 shutdown_connections 2023-11-24T06:14:31.676 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.670+0000 7f0901437700 1 -- 172.21.15.106:0/839680085 wait complete. 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.671+0000 7f0901437700 1 Processor -- start 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.671+0000 7f0901437700 1 -- start start 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4005210 0x7f08fc14de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc160cb0 0x7f08fc1563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc161130 con 0x7f08fc161350 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc0caf30 con 0x7f08fc160cb0 2023-11-24T06:14:31.679 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08fc14e390 con 0x7f08e4005210 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59534/0 (socket says 172.21.15.106:59534) 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 -- 172.21.15.106:0/4011055056 learned_addr learned my addr 172.21.15.106:0/4011055056 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 -- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4005210 msgr2=0x7f08fc14de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4005210 0x7f08fc14de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 -- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc160cb0 msgr2=0x7f08fc1563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc160cb0 0x7f08fc1563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 -- 172.21.15.106:0/4011055056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08fc0cb180 con 0x7f08fc161350 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08fa7fc700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a2c0 tx=0x7f08ec00a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec019070 con 0x7f08fc161350 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ec00ac90 con 0x7f08fc161350 2023-11-24T06:14:31.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08fc15f3a0 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.672+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ec01d410 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.673+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08fc15f960 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.673+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08fc0751e0 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.674+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08ec01d590 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.674+0000 7f08e37fe700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 0x7f08e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.674+0000 7f08faffd700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 0x7f08e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.674+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f08ec090cd0 con 0x7f08fc161350 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.675+0000 7f08faffd700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 0x7f08e806d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f00093c0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:31.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.679+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08ec05c050 con 0x7f08fc161350 2023-11-24T06:14:31.952 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.949+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f08fc0d2e70 con 0x7f08fc161350 2023-11-24T06:14:31.953 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.951+0000 7f08e37fe700 1 -- 172.21.15.106:0/4011055056 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08ec022030 con 0x7f08fc161350 2023-11-24T06:14:31.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 msgr2=0x7f08e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.956 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 0x7f08e806d390 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08f0009ae0 tx=0x7f08f00093c0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 msgr2=0x7f08fc160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08ec00a2c0 tx=0x7f08ec00a680 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 shutdown_connections 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f08e806aed0 0x7f08e806d390 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f08fc160cb0 0x7f08fc1563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f08e4005210 0x7f08fc14de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 --2- 172.21.15.106:0/4011055056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08fc161350 0x7f08fc160770 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.953+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 >> 172.21.15.106:0/4011055056 conn(0x7f08fc0b5b50 msgr2=0x7f08fc14efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.954+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 shutdown_connections 2023-11-24T06:14:31.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:31.954+0000 7f0901437700 1 -- 172.21.15.106:0/4011055056 wait complete. 2023-11-24T06:14:31.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-24T06:14:32.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.086+0000 7f960a65f700 1 Processor -- start 2023-11-24T06:14:32.089 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.086+0000 7f960a65f700 1 -- start start 2023-11-24T06:14:32.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f960a65f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f96040d3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f960a65f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040d2d10 con 0x7f960415dfc0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f960a65f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040cefd0 con 0x7f96040d1570 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f960a65f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040cf2b0 con 0x7f96040b2fc0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9603fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f960415dfc0 0x7f96040d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39802/0 (socket says 172.21.15.106:39802) 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9603fff700 1 -- 172.21.15.106:0/3270224469 learned_addr learned my addr 172.21.15.106:0/3270224469 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9608bfc700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f96040d3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436865434 0 0) 0x7f96040d2d10 con 0x7f960415dfc0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ec0035b0 con 0x7f960415dfc0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.087+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1168101802 0 0) 0x7f95ec0035b0 con 0x7f960415dfc0 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 msgr2=0x7f96040d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f96040d3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 >> v1:172.21.15.176:6789/0 conn(0x7f96040d1570 legacy=0x7f96040d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040d2fb0 con 0x7f960415dfc0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f95f8001670 con 0x7f960415dfc0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 >> v1:172.21.15.106:6789/0 conn(0x7f960415dfc0 legacy=0x7f96040d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f95ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95ec0043e0 0x7f95ec0048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f95ec0051b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040cf2b0 con 0x7f95ec003a30 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec00baf0 con 0x7f95ec0043e0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec00bcb0 con 0x7f96040b2fc0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f95ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f96037fe700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95ec0043e0 0x7f95ec0048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9608bfc700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f95ec0051b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.094 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 -- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 msgr2=0x7f95ec0051b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f96040b2fc0 0x7f95ec0051b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 -- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95ec0043e0 msgr2=0x7f95ec0048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f95ec0043e0 0x7f95ec0048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 -- 172.21.15.106:0/3270224469 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec0035b0 con 0x7f95ec003a30 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9603fff700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f95ec003e10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c2f0 tx=0x7f95ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941440632acfa90d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f800ce30 con 0x7f95ec003a30 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8005960 con 0x7f95ec003a30 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.088+0000 7f9602ffd700 1 -- 172.21.15.106:0/3270224469 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8005cf0 con 0x7f95ec003a30 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 -- 172.21.15.106:0/3270224469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 msgr2=0x7f95ec003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 --2- 172.21.15.106:0/3270224469 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f95ec003e10 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c2f0 tx=0x7f95ec005880 comp rx=0 tx=0).stop 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f9608bfc700 1 -- 172.21.15.106:0/3270224469 reap_dead start 2023-11-24T06:14:32.095 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 -- 172.21.15.106:0/3270224469 shutdown_connections 2023-11-24T06:14:32.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 -- 172.21.15.106:0/3270224469 >> 172.21.15.106:0/3270224469 conn(0x7f960406b410 msgr2=0x7f960406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:32.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 -- 172.21.15.106:0/3270224469 shutdown_connections 2023-11-24T06:14:32.096 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.089+0000 7f960a65f700 1 -- 172.21.15.106:0/3270224469 wait complete. 2023-11-24T06:14:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.090+0000 7f960a65f700 1 Processor -- start 2023-11-24T06:14:32.098 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 -- start start 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96040cc620 0x7f9604160fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f960414f290 0x7f96040cd000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96041614e0 con 0x7f95ec003a30 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040cb580 con 0x7f96040cc620 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f960a65f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040cb860 con 0x7f960414f290 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.091+0000 7f9603fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59552/0 (socket says 172.21.15.106:59552) 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 -- 172.21.15.106:0/2228262976 learned_addr learned my addr 172.21.15.106:0/2228262976 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f96037fe700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96040cc620 0x7f9604160fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9608bfc700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f960414f290 0x7f96040cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 -- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f960414f290 msgr2=0x7f96040cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.099 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f960414f290 0x7f96040cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 -- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96040cc620 msgr2=0x7f9604160fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96040cc620 0x7f9604160fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 -- 172.21.15.106:0/2228262976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040cbb40 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9603fff700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bac0 tx=0x7f95f8001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8001660 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8001000 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8004cc0 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96040cbe20 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.092+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960414f740 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.093+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604067f60 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.094+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95f80070d0 con 0x7f95ec003a30 2023-11-24T06:14:32.100 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.094+0000 7f9600ff9700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 0x7f95f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.094+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f95f808a6e0 con 0x7f95ec003a30 2023-11-24T06:14:32.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.094+0000 7f96037fe700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 0x7f95f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.094+0000 7f96037fe700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 0x7f95f006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95f4007a10 tx=0x7f95f4007980 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.101 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.099+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95f8055c30 con 0x7f95ec003a30 2023-11-24T06:14:32.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.370+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f96041614e0 con 0x7f95ec003a30 2023-11-24T06:14:32.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.372+0000 7f9600ff9700 1 -- 172.21.15.106:0/2228262976 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f95f8007da0 con 0x7f95ec003a30 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 msgr2=0x7f95f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 0x7f95f006d390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f95f4007a10 tx=0x7f95f4007980 comp rx=0 tx=0).stop 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 msgr2=0x7f96040cafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00bac0 tx=0x7f95f8001a00 comp rx=0 tx=0).stop 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 shutdown_connections 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f95f006aed0 0x7f95f006d390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f960414f290 0x7f96040cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f95ec003a30 0x7f96040cafa0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 --2- 172.21.15.106:0/2228262976 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f96040cc620 0x7f9604160fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 >> 172.21.15.106:0/2228262976 conn(0x7f960406b410 msgr2=0x7f96040b92a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:32.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 shutdown_connections 2023-11-24T06:14:32.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.375+0000 7f960a65f700 1 -- 172.21.15.106:0/2228262976 wait complete. 2023-11-24T06:14:32.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:32.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.507+0000 7f59c3af3700 1 Processor -- start 2023-11-24T06:14:32.510 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.507+0000 7f59c3af3700 1 -- start start 2023-11-24T06:14:32.512 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c3af3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59bc0b0ba0 0x7f59bc0af5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c3af3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f59bc15ee90 0x7f59bc15b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c3af3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0b2bd0 con 0x7f59bc0b0f80 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c3af3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0b1fc0 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c3af3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0b22a0 con 0x7f59bc15ee90 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c188f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59bc0b0ba0 0x7f59bc0af5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c108e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f59bc0b0f80 0x7f59bc0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39822/0 (socket says 172.21.15.106:39822) 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c108e700 1 -- 172.21.15.106:0/1943053672 learned_addr learned my addr 172.21.15.106:0/1943053672 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c2090700 1 --2- 172.21.15.106:0/1943053672 >> v2:172.21.15.176:3300/0 conn(0x7f59bc15ee90 0x7f59bc15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c188f700 1 -- 172.21.15.106:0/1943053672 >> v2:172.21.15.176:3300/0 conn(0x7f59bc15ee90 msgr2=0x7f59bc15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.513 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c188f700 1 --2- 172.21.15.106:0/1943053672 >> v2:172.21.15.176:3300/0 conn(0x7f59bc15ee90 0x7f59bc15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c188f700 1 -- 172.21.15.106:0/1943053672 >> v1:172.21.15.106:6789/0 conn(0x7f59bc0b0f80 legacy=0x7f59bc0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c088d700 1 -- 172.21.15.106:0/1943053672 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015235038 0 0) 0x7f59bc0b2bd0 con 0x7f59bc0b0f80 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.508+0000 7f59c188f700 1 -- 172.21.15.106:0/1943053672 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0b2580 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c188f700 1 --2- 172.21.15.106:0/1943053672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0af5c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0b2b40 tx=0x7f59ac00bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b7893d5a482a249 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c088d700 1 -- 172.21.15.106:0/1943053672 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00dc70 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c088d700 1 -- 172.21.15.106:0/1943053672 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59ac00ddd0 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c088d700 1 -- 172.21.15.106:0/1943053672 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59ac010690 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 -- 172.21.15.106:0/1943053672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc0b0ba0 msgr2=0x7f59bc0af5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 --2- 172.21.15.106:0/1943053672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0af5c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0b2b40 tx=0x7f59ac00bdc0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.514 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 -- 172.21.15.106:0/1943053672 shutdown_connections 2023-11-24T06:14:32.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 --2- 172.21.15.106:0/1943053672 >> v2:172.21.15.176:3300/0 conn(0x7f59bc15ee90 0x7f59bc15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 --2- 172.21.15.106:0/1943053672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0af5c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 -- 172.21.15.106:0/1943053672 >> 172.21.15.106:0/1943053672 conn(0x7f59bc0b57b0 msgr2=0x7f59bc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:32.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 -- 172.21.15.106:0/1943053672 shutdown_connections 2023-11-24T06:14:32.515 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.509+0000 7f59c3af3700 1 -- 172.21.15.106:0/1943053672 wait complete. 2023-11-24T06:14:32.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 Processor -- start 2023-11-24T06:14:32.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 -- start start 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 0x7f59bc15cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15c880 con 0x7f59bc15ee90 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1efdc0 con 0x7f59bc0b0ba0 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c3af3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15bc90 con 0x7f59bc0b0f80 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c2090700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c2090700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59570/0 (socket says 172.21.15.106:59570) 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.511+0000 7f59c2090700 1 -- 172.21.15.106:0/2829844848 learned_addr learned my addr 172.21.15.106:0/2829844848 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c188f700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.518 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c108e700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 0x7f59bc15cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 -- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 msgr2=0x7f59bc15cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 0x7f59bc15cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 -- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59bc0b0ba0 msgr2=0x7f59bc0b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 -- 172.21.15.106:0/2829844848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ac00b740 con 0x7f59bc15ee90 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c108e700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 0x7f59bc15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c2090700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59b4007e60 tx=0x7f59b400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b400ede0 con 0x7f59bc15ee90 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b4014420 con 0x7f59bc15ee90 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc0ae030 con 0x7f59bc15ee90 2023-11-24T06:14:32.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40147d0 con 0x7f59bc15ee90 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.512+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc15c230 con 0x7f59bc15ee90 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.513+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc15c9f0 con 0x7f59bc15ee90 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.513+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f59b4014930 con 0x7f59bc15ee90 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.514+0000 7f59b27fc700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 0x7f59a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.514+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f59b40899a0 con 0x7f59bc15ee90 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.514+0000 7f59c188f700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 0x7f59a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.514+0000 7f59c188f700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 0x7f59a006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00b2c0 tx=0x7f59ac013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.518+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f59b4054da0 con 0x7f59bc15ee90 2023-11-24T06:14:32.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.711+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59bc067f60 con 0x7f59bc15ee90 2023-11-24T06:14:32.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.711+0000 7f59b27fc700 1 -- 172.21.15.106:0/2829844848 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12881 (secure 0 0 0) 0x7f59b40583c0 con 0x7f59bc15ee90 2023-11-24T06:14:32.714 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:32.715 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":29,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:29.433046+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:32.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 msgr2=0x7f59a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 0x7f59a006d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00b2c0 tx=0x7f59ac013000 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 msgr2=0x7f59bc15d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59b4007e60 tx=0x7f59b400e3c0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 shutdown_connections 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f59a006aed0 0x7f59a006d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15ee90 0x7f59bc15d250 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f59bc0b0ba0 0x7f59bc0b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 --2- 172.21.15.106:0/2829844848 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f59bc0b0f80 0x7f59bc15cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 >> 172.21.15.106:0/2829844848 conn(0x7f59bc0b57b0 msgr2=0x7f59bc06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:32.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 shutdown_connections 2023-11-24T06:14:32.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.714+0000 7f59c3af3700 1 -- 172.21.15.106:0/2829844848 wait complete. 2023-11-24T06:14:32.728 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:32.729 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:32.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.850+0000 7f03b69a2700 1 Processor -- start 2023-11-24T06:14:32.853 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.850+0000 7f03b69a2700 1 -- start start 2023-11-24T06:14:32.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b69a2700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f03b00746a0 0x7f03b00b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.856 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b69a2700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00b3c60 con 0x7f03b00afc90 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b69a2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03b00b58c0 con 0x7f03b015e160 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b69a2700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03b00b4500 con 0x7f03b00746a0 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b4f3f700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f03b00afc90 0x7f03b006d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39840/0 (socket says 172.21.15.106:39840) 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03b4f3f700 1 -- 172.21.15.106:0/1975270817 learned_addr learned my addr 172.21.15.106:0/1975270817 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03af7fe700 1 --2- 172.21.15.106:0/1975270817 >> v2:172.21.15.176:3300/0 conn(0x7f03b00746a0 0x7f03b00b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1466809674 0 0) 0x7f03b00b3c60 con 0x7f03b00afc90 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f039c0035b0 con 0x7f03b00afc90 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1085906286 0 0) 0x7f039c0035b0 con 0x7f03b00afc90 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 >> v2:172.21.15.176:3300/0 conn(0x7f03b00746a0 msgr2=0x7f03b00b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 --2- 172.21.15.106:0/1975270817 >> v2:172.21.15.176:3300/0 conn(0x7f03b00746a0 0x7f03b00b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 >> v1:172.21.15.176:6789/0 conn(0x7f03b015e160 legacy=0x7f03b0073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b006bdc0 con 0x7f03b00afc90 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f03a80019f0 con 0x7f03b00afc90 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 >> v1:172.21.15.106:6789/0 conn(0x7f03b00afc90 legacy=0x7f03b006d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.851+0000 7f03aeffd700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 0x7f039c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f039c004850 0x7f039c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c005210 0x7f039c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00b4500 con 0x7f039c003a00 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00c0b0 con 0x7f039c004850 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f039c00c270 con 0x7f039c005210 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 0x7f039c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03af7fe700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f039c004850 0x7f039c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03b4f3f700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c005210 0x7f039c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 -- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c005210 msgr2=0x7f039c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c005210 0x7f039c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 -- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f039c004850 msgr2=0x7f039c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f039c004850 0x7f039c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 -- 172.21.15.106:0/1975270817 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c0035b0 con 0x7f039c003a00 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03b4f3f700 1 -- 172.21.15.106:0/1975270817 reap_dead start 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03affff700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 0x7f039c003e20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03980017c0 tx=0x7f039c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd4a774fd2984313 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980052d0 con 0x7f039c003a00 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0398005430 con 0x7f039c003a00 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.852+0000 7f03aeffd700 1 -- 172.21.15.106:0/1975270817 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03980038c0 con 0x7f039c003a00 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 -- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 msgr2=0x7f039c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 0x7f039c003e20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f03980017c0 tx=0x7f039c005880 comp rx=0 tx=0).stop 2023-11-24T06:14:32.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 -- 172.21.15.106:0/1975270817 shutdown_connections 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 --2- 172.21.15.106:0/1975270817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f039c003a00 0x7f039c003e20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 -- 172.21.15.106:0/1975270817 >> 172.21.15.106:0/1975270817 conn(0x7f03b00d0bf0 msgr2=0x7f03b00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 -- 172.21.15.106:0/1975270817 shutdown_connections 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.853+0000 7f03b69a2700 1 -- 172.21.15.106:0/1975270817 wait complete. 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.854+0000 7f03b69a2700 1 Processor -- start 2023-11-24T06:14:32.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.854+0000 7f03b69a2700 1 -- start start 2023-11-24T06:14:32.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c003a00 0x7f03b014a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 0x7f03b00c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b014df10 con 0x7f03b014cf70 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03b00cb3c0 con 0x7f03b014b420 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03b014d950 con 0x7f039c003a00 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59588/0 (socket says 172.21.15.106:59588) 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 -- 172.21.15.106:0/3796003091 learned_addr learned my addr 172.21.15.106:0/3796003091 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03affff700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c003a00 0x7f03b014a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b4f3f700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 0x7f03b00c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 -- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c003a00 msgr2=0x7f03b014a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c003a00 0x7f03b014a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 -- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 msgr2=0x7f03b00c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 0x7f03b00c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 -- 172.21.15.106:0/3796003091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03b014dc30 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b4f3f700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 0x7f03b00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03af7fe700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011aa0 tx=0x7f03a0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000f940 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03a000faa0 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03a000fe50 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.855+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03b00c5d70 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.856+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03b00ca3a0 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.856+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03b00c5bd0 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.857+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f03a0014440 con 0x7f03b014cf70 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.857+0000 7f03acff9700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 0x7f039006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:32.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.857+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03a00899a0 con 0x7f03b014cf70 2023-11-24T06:14:32.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.857+0000 7f03affff700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 0x7f039006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:32.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.858+0000 7f03affff700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 0x7f039006d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0398005040 tx=0x7f0398009030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:32.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:32.862+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f03b00c5bd0 con 0x7f03b014cf70 2023-11-24T06:14:33.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.052+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03b00c5bd0 con 0x7f03b014cf70 2023-11-24T06:14:33.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.052+0000 7f03acff9700 1 -- 172.21.15.106:0/3796003091 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f03a0022020 con 0x7f03b014cf70 2023-11-24T06:14:33.055 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:33.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 msgr2=0x7f039006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 0x7f039006d3c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0398005040 tx=0x7f0398009030 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 msgr2=0x7f03b014aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f03a0011aa0 tx=0x7f03a0011db0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 shutdown_connections 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f039006af00 0x7f039006d3c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f03b014b420 0x7f03b00c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f039c003a00 0x7f03b014a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 --2- 172.21.15.106:0/3796003091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03b014cf70 0x7f03b014aee0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.054+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 >> 172.21.15.106:0/3796003091 conn(0x7f03b00d0bf0 msgr2=0x7f03b006e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.055+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 shutdown_connections 2023-11-24T06:14:33.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.055+0000 7f03b69a2700 1 -- 172.21.15.106:0/3796003091 wait complete. 2023-11-24T06:14:33.070 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-24T06:14:33.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.188+0000 7f10e2f69700 1 Processor -- start 2023-11-24T06:14:33.191 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.188+0000 7f10e2f69700 1 -- start start 2023-11-24T06:14:33.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e2f69700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10dc15a3b0 0x7f10dc0b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e2f69700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0cf360 0x7f10dc0b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e2f69700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc15a790 con 0x7f10dc0b3da0 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e2f69700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0cf8b0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e2f69700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc06d1d0 con 0x7f10dc0cf360 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10dc15a3b0 0x7f10dc0b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10dc15a3b0 0x7f10dc0b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59594/0 (socket says 172.21.15.106:59594) 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 -- 172.21.15.106:0/2033045364 learned_addr learned my addr 172.21.15.106:0/2033045364 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10dbfff700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0cf360 0x7f10dc0b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 -- 172.21.15.106:0/2033045364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0cf360 msgr2=0x7f10dc0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0cf360 0x7f10dc0b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 -- 172.21.15.106:0/2033045364 >> v1:172.21.15.176:6789/0 conn(0x7f10dc0b3da0 legacy=0x7f10dc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.189+0000 7f10e0d05700 1 -- 172.21.15.106:0/2033045364 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0b4c40 con 0x7f10dc15a3b0 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e0d05700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc0b3320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10d000bbc0 tx=0x7f10d000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3960e1c2298887e1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10db7fe700 1 -- 172.21.15.106:0/2033045364 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000dcf0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10db7fe700 1 -- 172.21.15.106:0/2033045364 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000de50 con 0x7f10dc15a3b0 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10db7fe700 1 -- 172.21.15.106:0/2033045364 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d0010690 con 0x7f10dc15a3b0 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 -- 172.21.15.106:0/2033045364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 msgr2=0x7f10dc0b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc0b3320 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f10d000bbc0 tx=0x7f10d000bed0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 -- 172.21.15.106:0/2033045364 shutdown_connections 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc0b3320 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 --2- 172.21.15.106:0/2033045364 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0cf360 0x7f10dc0b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 -- 172.21.15.106:0/2033045364 >> 172.21.15.106:0/2033045364 conn(0x7f10dc0b1740 msgr2=0x7f10dc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 -- 172.21.15.106:0/2033045364 shutdown_connections 2023-11-24T06:14:33.196 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.190+0000 7f10e2f69700 1 -- 172.21.15.106:0/2033045364 wait complete. 2023-11-24T06:14:33.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.192+0000 7f10e2f69700 1 Processor -- start 2023-11-24T06:14:33.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.192+0000 7f10e2f69700 1 -- start start 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0b3da0 0x7f10dc151080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc0cf360 0x7f10dc143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc157b70 con 0x7f10dc15a3b0 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc157260 con 0x7f10dc0cf360 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e2f69700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc15d610 con 0x7f10dc0b3da0 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59604/0 (socket says 172.21.15.106:59604) 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 -- 172.21.15.106:0/3846418016 learned_addr learned my addr 172.21.15.106:0/3846418016 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e0d05700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0b3da0 0x7f10dc151080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10dbfff700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc0cf360 0x7f10dc143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 -- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0b3da0 msgr2=0x7f10dc151080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0b3da0 0x7f10dc151080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 -- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc0cf360 msgr2=0x7f10dc143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc0cf360 0x7f10dc143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.193+0000 7f10e1506700 1 -- 172.21.15.106:0/3846418016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d000b7f0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10e1506700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d400cb50 tx=0x7f10d400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4003c00 con 0x7f10dc15a3b0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d4003d60 con 0x7f10dc15a3b0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400ab70 con 0x7f10dc15a3b0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc1574b0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.194+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc1515c0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.195+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc157cb0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.195+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f10d400acd0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.195+0000 7f10d97fa700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 0x7f10c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.196+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10d40892e0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.196+0000 7f10e0d05700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 0x7f10c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.196+0000 7f10e0d05700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 0x7f10c006d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0013000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.200+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f10dc157cb0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.392+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f10dc157cb0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.392+0000 7f10d97fa700 1 -- 172.21.15.106:0/3846418016 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7f10dc157cb0 con 0x7f10dc15a3b0 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "poolnum": 1, 2023-11-24T06:14:33.395 INFO:teuthology.orchestra.run.smithi106.stdout: "poolname": ".mgr" 2023-11-24T06:14:33.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:33.396 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-11-24T06:14:33.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.394+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 msgr2=0x7f10c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.394+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 0x7f10c006d390 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0013000 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 msgr2=0x7f10dc143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f10d400cb50 tx=0x7f10d400cf10 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 shutdown_connections 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f10c006aed0 0x7f10c006d390 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc15a3b0 0x7f10dc143760 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f10dc0b3da0 0x7f10dc151080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 --2- 172.21.15.106:0/3846418016 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f10dc0cf360 0x7f10dc143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 >> 172.21.15.106:0/3846418016 conn(0x7f10dc0b1740 msgr2=0x7f10dc06e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 shutdown_connections 2023-11-24T06:14:33.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.395+0000 7f10e2f69700 1 -- 172.21.15.106:0/3846418016 wait complete. 2023-11-24T06:14:33.409 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-24T06:14:33.409 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-24T06:14:33.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.530+0000 7f67387c6700 1 Processor -- start 2023-11-24T06:14:33.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.530+0000 7f67387c6700 1 -- start start 2023-11-24T06:14:33.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.531+0000 7f67387c6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673006e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.531+0000 7f67387c6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67300b59c0 0x7f67300b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.531+0000 7f67387c6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67300b5e40 con 0x7f6730073f90 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.531+0000 7f67387c6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67301470a0 con 0x7f67300b59c0 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.531+0000 7f67387c6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67300b05c0 con 0x7f67300b01e0 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67300b59c0 0x7f67300b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67300b59c0 0x7f67300b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59608/0 (socket says 172.21.15.106:59608) 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 -- 172.21.15.106:0/2544775616 learned_addr learned my addr 172.21.15.106:0/2544775616 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6736562700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673006e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 -- 172.21.15.106:0/2544775616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 msgr2=0x7f673006e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673006e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 -- 172.21.15.106:0/2544775616 >> v1:172.21.15.176:6789/0 conn(0x7f6730073f90 legacy=0x7f673006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 -- 172.21.15.106:0/2544775616 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67300b4250 con 0x7f67300b59c0 2023-11-24T06:14:33.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735d61700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67300b59c0 0x7f67300b3b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f672c0098f0 tx=0x7f672c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4730ac567c436420 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735560700 1 -- 172.21.15.106:0/2544775616 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00b8a0 con 0x7f67300b59c0 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735560700 1 -- 172.21.15.106:0/2544775616 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c00ba00 con 0x7f67300b59c0 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.532+0000 7f6735560700 1 -- 172.21.15.106:0/2544775616 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c00bd90 con 0x7f67300b59c0 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 -- 172.21.15.106:0/2544775616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67300b59c0 msgr2=0x7f67300b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67300b59c0 0x7f67300b3b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f672c0098f0 tx=0x7f672c009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 -- 172.21.15.106:0/2544775616 shutdown_connections 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673006e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 --2- 172.21.15.106:0/2544775616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67300b59c0 0x7f67300b3b50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 -- 172.21.15.106:0/2544775616 >> 172.21.15.106:0/2544775616 conn(0x7f67300d0b40 msgr2=0x7f67300d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 -- 172.21.15.106:0/2544775616 shutdown_connections 2023-11-24T06:14:33.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.533+0000 7f67387c6700 1 -- 172.21.15.106:0/2544775616 wait complete. 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.534+0000 7f67387c6700 1 Processor -- start 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.534+0000 7f67387c6700 1 -- start start 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67300b59c0 0x7f6730143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673015bd10 con 0x7f6730073f90 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6730142b70 con 0x7f67300b59c0 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.535+0000 7f67387c6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673015b100 con 0x7f67300b01e0 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59612/0 (socket says 172.21.15.106:59612) 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 -- 172.21.15.106:0/3619993722 learned_addr learned my addr 172.21.15.106:0/3619993722 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6735d61700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736d63700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67300b59c0 0x7f6730143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 -- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 msgr2=0x7f673015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 -- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67300b59c0 msgr2=0x7f6730143ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:33.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67300b59c0 0x7f6730143ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:33.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 -- 172.21.15.106:0/3619993722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009550 con 0x7f6730073f90 2023-11-24T06:14:33.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.536+0000 7f6736562700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f672000e810 tx=0x7f672000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.540+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720013610 con 0x7f6730073f90 2023-11-24T06:14:33.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.540+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673015b3e0 con 0x7f6730073f90 2023-11-24T06:14:33.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.540+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6720013770 con 0x7f6730073f90 2023-11-24T06:14:33.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.540+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6720013b20 con 0x7f6730073f90 2023-11-24T06:14:33.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.540+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673015b9a0 con 0x7f6730073f90 2023-11-24T06:14:33.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.541+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673015bff0 con 0x7f6730073f90 2023-11-24T06:14:33.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.542+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6720013c80 con 0x7f6730073f90 2023-11-24T06:14:33.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.542+0000 7f6726ffd700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 0x7f671406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:33.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.542+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6720088fb0 con 0x7f6730073f90 2023-11-24T06:14:33.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.542+0000 7f6735d61700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 0x7f671406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:33.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.542+0000 7f6735d61700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 0x7f671406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f672c009c40 tx=0x7f672c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:33.549 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.546+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f67200bbe90 con 0x7f6730073f90 2023-11-24T06:14:33.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:33.738+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6730067f60 con 0x7f6730073f90 2023-11-24T06:14:34.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.543+0000 7f6726ffd700 1 -- 172.21.15.106:0/3619993722 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f67200543c0 con 0x7f6730073f90 2023-11-24T06:14:34.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.546+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 msgr2=0x7f671406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.546+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 0x7f671406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f672c009c40 tx=0x7f672c008030 comp rx=0 tx=0).stop 2023-11-24T06:14:34.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.546+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 msgr2=0x7f6730142130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.546+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f672000e810 tx=0x7f672000ebd0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.550 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.546+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 shutdown_connections 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f671406aed0 0x7f671406d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f67300b59c0 0x7f6730143ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6730073f90 0x7f6730142130 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 --2- 172.21.15.106:0/3619993722 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f67300b01e0 0x7f673015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 >> 172.21.15.106:0/3619993722 conn(0x7f67300d0b40 msgr2=0x7f6730161a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 shutdown_connections 2023-11-24T06:14:34.551 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.547+0000 7f67387c6700 1 -- 172.21.15.106:0/3619993722 wait complete. 2023-11-24T06:14:34.552 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' created 2023-11-24T06:14:34.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-24T06:14:34.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.699+0000 7f9f99008700 1 Processor -- start 2023-11-24T06:14:34.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.699+0000 7f9f99008700 1 -- start start 2023-11-24T06:14:34.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.700+0000 7f9f99008700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f9f9415a620 0x7f9f940ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.700+0000 7f9f99008700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f9406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.700+0000 7f9f99008700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f940b2f20 con 0x7f9f940cc540 2023-11-24T06:14:34.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.700+0000 7f9f99008700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940629b0 con 0x7f9f9415a620 2023-11-24T06:14:34.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.700+0000 7f9f99008700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9406ef90 con 0x7f9f9406e5e0 2023-11-24T06:14:34.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f9259c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9f940cc540 0x7f9f940622a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39884/0 (socket says 172.21.15.106:39884) 2023-11-24T06:14:34.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f9259c700 1 -- 172.21.15.106:0/2872456345 learned_addr learned my addr 172.21.15.106:0/2872456345 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:34.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/2872456345 >> v2:172.21.15.176:3300/0 conn(0x7f9f9415a620 0x7f9f940ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f91d9b700 1 -- 172.21.15.106:0/2872456345 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422031244 0 0) 0x7f9f940b2f20 con 0x7f9f940cc540 2023-11-24T06:14:34.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f91d9b700 1 -- 172.21.15.106:0/2872456345 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f7c0035b0 con 0x7f9f940cc540 2023-11-24T06:14:34.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f9359e700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f9406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f92d9d700 1 -- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 msgr2=0x7f9f9406ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f9406ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f92d9d700 1 -- 172.21.15.106:0/2872456345 >> v1:172.21.15.106:6789/0 conn(0x7f9f940cc540 legacy=0x7f9f940622a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.701+0000 7f9f92d9d700 1 -- 172.21.15.106:0/2872456345 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940ce690 con 0x7f9f9415a620 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f940ce150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009870 tx=0x7f9f84009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f374788ef95fd232 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f91d9b700 1 -- 172.21.15.106:0/2872456345 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011830 con 0x7f9f9415a620 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f91d9b700 1 -- 172.21.15.106:0/2872456345 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011990 con 0x7f9f9415a620 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f91d9b700 1 -- 172.21.15.106:0/2872456345 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f84011d20 con 0x7f9f9415a620 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 -- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 msgr2=0x7f9f940ce150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f940ce150 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9f84009870 tx=0x7f9f84009b80 comp rx=0 tx=0).stop 2023-11-24T06:14:34.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 -- 172.21.15.106:0/2872456345 shutdown_connections 2023-11-24T06:14:34.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f9406ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 --2- 172.21.15.106:0/2872456345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f940ce150 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 -- 172.21.15.106:0/2872456345 >> 172.21.15.106:0/2872456345 conn(0x7f9f940b2050 msgr2=0x7f9f940b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:34.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 -- 172.21.15.106:0/2872456345 shutdown_connections 2023-11-24T06:14:34.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.702+0000 7f9f99008700 1 -- 172.21.15.106:0/2872456345 wait complete. 2023-11-24T06:14:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.704+0000 7f9f99008700 1 Processor -- start 2023-11-24T06:14:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.704+0000 7f9f99008700 1 -- start start 2023-11-24T06:14:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f94146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f9414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94148570 con 0x7f9f940cc540 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9414bbf0 con 0x7f9f9415a620 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f9414b350 con 0x7f9f9406e5e0 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59628/0 (socket says 172.21.15.106:59628) 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 -- 172.21.15.106:0/3743566472 learned_addr learned my addr 172.21.15.106:0/3743566472 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f94146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 -- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 msgr2=0x7f9f94146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9359e700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f9414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f94146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 -- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 msgr2=0x7f9f9414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f9414d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 -- 172.21.15.106:0/3743566472 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f840094a0 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f94146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9359e700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f9414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f9259c700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c700 tx=0x7f9f8800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88005d70 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f880070d0 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f9414b630 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.705+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f88007460 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.706+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f941487a0 con 0x7f9f940cc540 2023-11-24T06:14:34.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.706+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f94068d90 con 0x7f9f940cc540 2023-11-24T06:14:34.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.707+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f880075c0 con 0x7f9f940cc540 2023-11-24T06:14:34.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.707+0000 7f9f7b7fe700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 0x7f9f8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:34.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.708+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9f880889d0 con 0x7f9f940cc540 2023-11-24T06:14:34.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.708+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 0x7f9f8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:34.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.708+0000 7f9f92d9d700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 0x7f9f8006d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f840090b0 tx=0x7f9f84008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:34.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.712+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f88053c70 con 0x7f9f940cc540 2023-11-24T06:14:34.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:34.900+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9f9406f860 con 0x7f9f940cc540 2023-11-24T06:14:35.361 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-11-24T06:14:35.548 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.546+0000 7f9f7b7fe700 1 -- 172.21.15.106:0/3743566472 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9f88057290 con 0x7f9f940cc540 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 msgr2=0x7f9f8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 0x7f9f8006d390 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f840090b0 tx=0x7f9f84008030 comp rx=0 tx=0).stop 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 msgr2=0x7f9f9414aa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c700 tx=0x7f9f8800cac0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 shutdown_connections 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f9f8006aed0 0x7f9f8006d390 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f9f9415a620 0x7f9f9414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f9f9406e5e0 0x7f9f94146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 --2- 172.21.15.106:0/3743566472 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f940cc540 0x7f9f9414aa20 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f9f8800c700 tx=0x7f9f8800cac0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.550+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 >> 172.21.15.106:0/3743566472 conn(0x7f9f940b2050 msgr2=0x7f9f94150a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.554 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.552+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 shutdown_connections 2023-11-24T06:14:35.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.552+0000 7f9f99008700 1 -- 172.21.15.106:0/3743566472 wait complete. 2023-11-24T06:14:35.565 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' created 2023-11-24T06:14:35.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-24T06:14:35.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.704+0000 7f5b8def6700 1 Processor -- start 2023-11-24T06:14:35.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.704+0000 7f5b8def6700 1 -- start start 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b8def6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5b880b4310 0x7f5b8806bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b8def6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8806ba50 con 0x7f5b8815e080 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b8def6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8806b120 con 0x7f5b880ce430 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b8def6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880d1200 con 0x7f5b880b4310 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b86ffd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5b880b4310 0x7f5b8806bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b877fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5b8815e080 0x7f5b880d0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39896/0 (socket says 172.21.15.106:39896) 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b877fe700 1 -- 172.21.15.106:0/3273039906 learned_addr learned my addr 172.21.15.106:0/3273039906 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:35.709 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b86ffd700 1 -- 172.21.15.106:0/3273039906 >> v1:172.21.15.176:6789/0 conn(0x7f5b880ce430 legacy=0x7f5b880cc200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b86ffd700 1 -- 172.21.15.106:0/3273039906 >> v1:172.21.15.106:6789/0 conn(0x7f5b8815e080 legacy=0x7f5b880d0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b86ffd700 1 -- 172.21.15.106:0/3273039906 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8806b400 con 0x7f5b880b4310 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.705+0000 7f5b867fc700 1 -- 172.21.15.106:0/3273039906 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159022776 0 0) 0x7f5b8806ba50 con 0x7f5b8815e080 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b86ffd700 1 --2- 172.21.15.106:0/3273039906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b880b4310 0x7f5b8806bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009840 tx=0x7f5b78009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509df328211a2eb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b867fc700 1 -- 172.21.15.106:0/3273039906 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78004230 con 0x7f5b880b4310 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b867fc700 1 -- 172.21.15.106:0/3273039906 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78004390 con 0x7f5b880b4310 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b867fc700 1 -- 172.21.15.106:0/3273039906 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b780036a0 con 0x7f5b880b4310 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 -- 172.21.15.106:0/3273039906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b880b4310 msgr2=0x7f5b8806bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 --2- 172.21.15.106:0/3273039906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b880b4310 0x7f5b8806bee0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009840 tx=0x7f5b78009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 -- 172.21.15.106:0/3273039906 shutdown_connections 2023-11-24T06:14:35.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 --2- 172.21.15.106:0/3273039906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b880b4310 0x7f5b8806bee0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 -- 172.21.15.106:0/3273039906 >> 172.21.15.106:0/3273039906 conn(0x7f5b880b3780 msgr2=0x7f5b880b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:35.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 -- 172.21.15.106:0/3273039906 shutdown_connections 2023-11-24T06:14:35.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.706+0000 7f5b8def6700 1 -- 172.21.15.106:0/3273039906 wait complete. 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.707+0000 7f5b8def6700 1 Processor -- start 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 -- start start 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 0x7f5b880c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 0x7f5b88150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c9d30 con 0x7f5b8815e080 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c9fa0 con 0x7f5b880b4310 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.708+0000 7f5b8def6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880ca280 con 0x7f5b880ce430 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59644/0 (socket says 172.21.15.106:59644) 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 -- 172.21.15.106:0/2437673617 learned_addr learned my addr 172.21.15.106:0/2437673617 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b86ffd700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 0x7f5b88150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b877fe700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 0x7f5b880c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 -- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 msgr2=0x7f5b88150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 0x7f5b88150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 -- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 msgr2=0x7f5b880c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 0x7f5b880c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:35.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 -- 172.21.15.106:0/2437673617 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780094a0 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b877fe700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 0x7f5b880c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b86ffd700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 0x7f5b88150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b87fff700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c7a0 tx=0x7f5b8000cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80003e10 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b80005070 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880ca560 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b80005420 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.709+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b881513e0 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.710+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b88068fb0 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.711+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b80005580 con 0x7f5b8815e080 2023-11-24T06:14:35.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.711+0000 7f5b6ffff700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 0x7f5b7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:35.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.711+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f5b80088970 con 0x7f5b8815e080 2023-11-24T06:14:35.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.711+0000 7f5b877fe700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 0x7f5b7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:35.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.712+0000 7f5b877fe700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 0x7f5b7406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c000f60 tx=0x7f5b7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:35.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.716+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b80053a80 con 0x7f5b8815e080 2023-11-24T06:14:35.951 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:35.949+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5b880b7ab0 con 0x7f5b8815e080 2023-11-24T06:14:36.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.894+0000 7f5b6ffff700 1 -- 172.21.15.106:0/2437673617 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f5b80017020 con 0x7f5b8815e080 2023-11-24T06:14:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 msgr2=0x7f5b7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 0x7f5b7406d390 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c000f60 tx=0x7f5b7c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 msgr2=0x7f5b88160ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000c7a0 tx=0x7f5b8000cb60 comp rx=0 tx=0).stop 2023-11-24T06:14:36.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 shutdown_connections 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7406aed0 0x7f5b7406d390 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8815e080 0x7f5b88160ce0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b880b4310 0x7f5b880c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 --2- 172.21.15.106:0/2437673617 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b880ce430 0x7f5b88150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.897+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 >> 172.21.15.106:0/2437673617 conn(0x7f5b880b3780 msgr2=0x7f5b880cda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.898+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 shutdown_connections 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:36.898+0000 7f5b8def6700 1 -- 172.21.15.106:0/2437673617 wait complete. 2023-11-24T06:14:36.901 INFO:teuthology.orchestra.run.smithi106.stderr:new fs with metadata pool 4 and data pool 5 2023-11-24T06:14:36.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:37.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.041+0000 7fa880f0a700 1 Processor -- start 2023-11-24T06:14:37.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.041+0000 7fa880f0a700 1 -- start start 2023-11-24T06:14:37.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa880f0a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa87c073f90 0x7fa87c074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa880f0a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c06e7f0 con 0x7fa87c15e2a0 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa880f0a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa87c06dec0 con 0x7fa87c0ce090 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa880f0a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa87c074960 con 0x7fa87c073f90 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa87a59c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa87c15e2a0 0x7fa87c06ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39910/0 (socket says 172.21.15.106:39910) 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.042+0000 7fa87a59c700 1 -- 172.21.15.106:0/3906980345 learned_addr learned my addr 172.21.15.106:0/3906980345 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3684104250 0 0) 0x7fa87c06e7f0 con 0x7fa87c15e2a0 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87ad9d700 1 --2- 172.21.15.106:0/3906980345 >> v2:172.21.15.176:3300/0 conn(0x7fa87c073f90 0x7fa87c074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8640035b0 con 0x7fa87c15e2a0 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3303723799 0 0) 0x7fa8640035b0 con 0x7fa87c15e2a0 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 >> v2:172.21.15.176:3300/0 conn(0x7fa87c073f90 msgr2=0x7fa87c074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 --2- 172.21.15.106:0/3906980345 >> v2:172.21.15.176:3300/0 conn(0x7fa87c073f90 0x7fa87c074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 >> v1:172.21.15.176:6789/0 conn(0x7fa87c0ce090 legacy=0x7fa87c06ec80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c06e1a0 con 0x7fa87c15e2a0 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fa870001670 con 0x7fa87c15e2a0 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 >> v1:172.21.15.106:6789/0 conn(0x7fa87c15e2a0 legacy=0x7fa87c06ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa864003a00 0x7fa864003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa864004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa864005210 0x7fa86400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c074960 con 0x7fa864004850 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86400c140 con 0x7fa864005210 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86400c300 con 0x7fa864003a00 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa864004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87a59c700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa864003a00 0x7fa864003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87ad9d700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa864005210 0x7fa86400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 -- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa864003a00 msgr2=0x7fa864003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa864003a00 0x7fa864003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 -- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa864005210 msgr2=0x7fa86400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa864005210 0x7fa86400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87ad9d700 1 -- 172.21.15.106:0/3906980345 reap_dead start 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 -- 172.21.15.106:0/3906980345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8640035b0 con 0x7fa864004850 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa87a59c700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa864003a00 0x7fa864003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.043+0000 7fa879d9b700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa864004cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009860 tx=0x7fa864005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f92ebcd4f5b1ea server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0092d0 con 0x7fa864004850 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa86c011620 con 0x7fa864004850 2023-11-24T06:14:37.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa87959a700 1 -- 172.21.15.106:0/3906980345 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86c0119d0 con 0x7fa864004850 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 -- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 msgr2=0x7fa864004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa864004cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009860 tx=0x7fa864005880 comp rx=0 tx=0).stop 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 -- 172.21.15.106:0/3906980345 shutdown_connections 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 --2- 172.21.15.106:0/3906980345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa864004cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 -- 172.21.15.106:0/3906980345 >> 172.21.15.106:0/3906980345 conn(0x7fa87c0cd570 msgr2=0x7fa87c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 -- 172.21.15.106:0/3906980345 shutdown_connections 2023-11-24T06:14:37.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.044+0000 7fa880f0a700 1 -- 172.21.15.106:0/3906980345 wait complete. 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 Processor -- start 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 -- start start 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 0x7fa87c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c14ce10 0x7fa87c14eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c14e350 con 0x7fa864004850 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c14d740 con 0x7fa87c14fb90 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa880f0a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa87c14da20 con 0x7fa87c14ce10 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa87a59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa87a59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59658/0 (socket says 172.21.15.106:59658) 2023-11-24T06:14:37.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.046+0000 7fa87a59c700 1 -- 172.21.15.106:0/81143207 learned_addr learned my addr 172.21.15.106:0/81143207 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa879d9b700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 0x7fa87c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 -- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c14ce10 msgr2=0x7fa87c14eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c14ce10 0x7fa87c14eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 -- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 msgr2=0x7fa87c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 0x7fa87c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 -- 172.21.15.106:0/81143207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c14dd00 con 0x7fa864004850 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa879d9b700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 0x7fa87c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa87a59c700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa870001cb0 tx=0x7fa87000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000c550 con 0x7fa864004850 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87000c6b0 con 0x7fa864004850 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87c14dfe0 con 0x7fa864004850 2023-11-24T06:14:37.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000ca20 con 0x7fa864004850 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.047+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa87c14d2c0 con 0x7fa864004850 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.048+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa87c14e630 con 0x7fa864004850 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.048+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa87000cb80 con 0x7fa864004850 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.049+0000 7fa86affd700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.049+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa870089460 con 0x7fa864004850 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.049+0000 7fa879d9b700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.049+0000 7fa879d9b700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 0x7fa85c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa87c15c8c0 tx=0x7fa86c01c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.053+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa870054480 con 0x7fa864004850 2023-11-24T06:14:37.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.249+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa87c14d4b0 con 0x7fa864004850 2023-11-24T06:14:37.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.250+0000 7fa86affd700 1 -- 172.21.15.106:0/81143207 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16606 (secure 0 0 0) 0x7fa870057aa0 con 0x7fa864004850 2023-11-24T06:14:37.253 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:37.253 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":32,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:35.950313+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:37.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.252+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 msgr2=0x7fa85c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.252+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 0x7fa85c06d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa87c15c8c0 tx=0x7fa86c01c040 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 msgr2=0x7fa87c14e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa870001cb0 tx=0x7fa87000ee00 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 shutdown_connections 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa85c06af00 0x7fa85c06d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa87c14ce10 0x7fa87c14eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa864004850 0x7fa87c14e7e0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 --2- 172.21.15.106:0/81143207 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa87c14fb90 0x7fa87c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 >> 172.21.15.106:0/81143207 conn(0x7fa87c0cd570 msgr2=0x7fa87c06c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 shutdown_connections 2023-11-24T06:14:37.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.253+0000 7fa880f0a700 1 -- 172.21.15.106:0/81143207 wait complete. 2023-11-24T06:14:37.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:37.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 Processor -- start 2023-11-24T06:14:37.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 -- start start 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f001015e080 0x7f00100b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 0x7f00100afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f001006c000 0x7f001006c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00100af0b0 con 0x7f001006c000 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001006c9f0 con 0x7f00100af4d0 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f00167d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00100b05a0 con 0x7f001015e080 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.385+0000 7f0014d76700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f001006c000 0x7f001006c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f001006c000 0x7f001006c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59666/0 (socket says 172.21.15.106:59666) 2023-11-24T06:14:37.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 -- 172.21.15.106:0/527480899 learned_addr learned my addr 172.21.15.106:0/527480899 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000f7fe700 1 --2- 172.21.15.106:0/527480899 >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 0x7f00100afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000ffff700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f001015e080 0x7f00100b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 -- 172.21.15.106:0/527480899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f001015e080 msgr2=0x7f00100b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f001015e080 0x7f00100b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 -- 172.21.15.106:0/527480899 >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 msgr2=0x7f00100afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 --2- 172.21.15.106:0/527480899 >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 0x7f00100afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 -- 172.21.15.106:0/527480899 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00100ae430 con 0x7f001006c000 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000f7fe700 1 --2- 172.21.15.106:0/527480899 >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 0x7f00100afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f0014d76700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001006c000 0x7f001006c4b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f001006d380 tx=0x7f000800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9541127b7147723 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000effd700 1 -- 172.21.15.106:0/527480899 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800e070 con 0x7f001006c000 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000effd700 1 -- 172.21.15.106:0/527480899 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000800b980 con 0x7f001006c000 2023-11-24T06:14:37.391 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.386+0000 7f000effd700 1 -- 172.21.15.106:0/527480899 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f000800bd30 con 0x7f001006c000 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 -- 172.21.15.106:0/527480899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001006c000 msgr2=0x7f001006c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001006c000 0x7f001006c4b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f001006d380 tx=0x7f000800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 -- 172.21.15.106:0/527480899 shutdown_connections 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001006c000 0x7f001006c4b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 --2- 172.21.15.106:0/527480899 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f001015e080 0x7f00100b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 --2- 172.21.15.106:0/527480899 >> v2:172.21.15.176:3300/0 conn(0x7f00100af4d0 0x7f00100afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 -- 172.21.15.106:0/527480899 >> 172.21.15.106:0/527480899 conn(0x7f0010071b90 msgr2=0x7f0010071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 -- 172.21.15.106:0/527480899 shutdown_connections 2023-11-24T06:14:37.392 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.387+0000 7f00167d9700 1 -- 172.21.15.106:0/527480899 wait complete. 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.388+0000 7f00167d9700 1 Processor -- start 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.388+0000 7f00167d9700 1 -- start start 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001006c000 0x7f00101558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00100af4d0 0x7f00101592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0010155e10 con 0x7f001015e080 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00101f3c50 con 0x7f001006c000 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f00167d9700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00101f3f30 con 0x7f00100af4d0 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.395 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59676/0 (socket says 172.21.15.106:59676) 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 -- 172.21.15.106:0/1804257524 learned_addr learned my addr 172.21.15.106:0/1804257524 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f000ffff700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001006c000 0x7f00101558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f000f7fe700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00100af4d0 0x7f00101592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 -- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00100af4d0 msgr2=0x7f00101592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00100af4d0 0x7f00101592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 -- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001006c000 msgr2=0x7f00101558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001006c000 0x7f00101558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.389+0000 7f0014d76700 1 -- 172.21.15.106:0/1804257524 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0008009b30 con 0x7f001015e080 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f0014d76700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f001009f040 tx=0x7f0008004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080099b0 con 0x7f001015e080 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0008004250 con 0x7f001015e080 2023-11-24T06:14:37.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00101f4210 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00080045e0 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.390+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00101f47d0 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.391+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00100753f0 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.391+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0008004740 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.391+0000 7f000cff9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 0x7efff006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.391+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f000808ab10 con 0x7f001015e080 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.391+0000 7f000ffff700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 0x7efff006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.392+0000 7f000ffff700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 0x7efff006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.396+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0008055bd0 con 0x7f001015e080 2023-11-24T06:14:37.588 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.586+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00101f4960 con 0x7f001015e080 2023-11-24T06:14:37.590 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.587+0000 7f000cff9700 1 -- 172.21.15.106:0/1804257524 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f00080591f0 con 0x7f001015e080 2023-11-24T06:14:37.590 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:37.590 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 msgr2=0x7efff006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 0x7efff006d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7efff8006fd0 tx=0x7efff8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 msgr2=0x7f00100cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f001009f040 tx=0x7f0008004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 shutdown_connections 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efff006aed0 0x7efff006d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.592 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f001015e080 0x7f00100cf8c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f001006c000 0x7f00101558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 --2- 172.21.15.106:0/1804257524 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f00100af4d0 0x7f00101592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 >> 172.21.15.106:0/1804257524 conn(0x7f0010071b90 msgr2=0x7f00100b4340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 shutdown_connections 2023-11-24T06:14:37.593 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.589+0000 7f00167d9700 1 -- 172.21.15.106:0/1804257524 wait complete. 2023-11-24T06:14:37.604 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-24T06:14:37.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.726+0000 7fb0eacb5700 1 Processor -- start 2023-11-24T06:14:37.729 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.726+0000 7fb0eacb5700 1 -- start start 2023-11-24T06:14:37.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0eacb5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb0e415e160 0x7fb0e40b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0eacb5700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0e40afc90 0x7fb0e4073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0eacb5700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0e40b3c60 con 0x7fb0e40744d0 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0eacb5700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e40b4500 con 0x7fb0e40afc90 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0eacb5700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0e4074940 con 0x7fb0e415e160 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0e3fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0e40afc90 0x7fb0e4073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0e9252700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb0e40744d0 0x7fb0e406d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39946/0 (socket says 172.21.15.106:39946) 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.727+0000 7fb0e9252700 1 -- 172.21.15.106:0/4082828948 learned_addr learned my addr 172.21.15.106:0/4082828948 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e3fff700 1 -- 172.21.15.106:0/4082828948 >> v2:172.21.15.176:3300/0 conn(0x7fb0e415e160 msgr2=0x7fb0e40b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e3fff700 1 --2- 172.21.15.106:0/4082828948 >> v2:172.21.15.176:3300/0 conn(0x7fb0e415e160 0x7fb0e40b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e3fff700 1 -- 172.21.15.106:0/4082828948 >> v1:172.21.15.106:6789/0 conn(0x7fb0e40744d0 legacy=0x7fb0e406d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e3fff700 1 -- 172.21.15.106:0/4082828948 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e40b58c0 con 0x7fb0e40afc90 2023-11-24T06:14:37.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e37fe700 1 -- 172.21.15.106:0/4082828948 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925568528 0 0) 0x7fb0e40b3c60 con 0x7fb0e40744d0 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e3fff700 1 --2- 172.21.15.106:0/4082828948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e4073f90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0e409efa0 tx=0x7fb0d0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4af645d5b114fff server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e37fe700 1 -- 172.21.15.106:0/4082828948 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0011830 con 0x7fb0e40afc90 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e37fe700 1 -- 172.21.15.106:0/4082828948 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d0011990 con 0x7fb0e40afc90 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0e37fe700 1 -- 172.21.15.106:0/4082828948 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0011d20 con 0x7fb0e40afc90 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 -- 172.21.15.106:0/4082828948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 msgr2=0x7fb0e4073f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/4082828948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e4073f90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fb0e409efa0 tx=0x7fb0d0009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 -- 172.21.15.106:0/4082828948 shutdown_connections 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/4082828948 >> v2:172.21.15.176:3300/0 conn(0x7fb0e415e160 0x7fb0e40b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/4082828948 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e4073f90 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 -- 172.21.15.106:0/4082828948 >> 172.21.15.106:0/4082828948 conn(0x7fb0e40d0bf0 msgr2=0x7fb0e40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:37.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 -- 172.21.15.106:0/4082828948 shutdown_connections 2023-11-24T06:14:37.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.728+0000 7fb0eacb5700 1 -- 172.21.15.106:0/4082828948 wait complete. 2023-11-24T06:14:37.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 Processor -- start 2023-11-24T06:14:37.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 -- start start 2023-11-24T06:14:37.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 0x7fb0e415ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e415e160 0x7fb0e4153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e415f220 con 0x7fb0e40afc90 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e414ce20 con 0x7fb0e415e160 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.730+0000 7fb0eacb5700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e40b03f0 con 0x7fb0e40744d0 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59688/0 (socket says 172.21.15.106:59688) 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 -- 172.21.15.106:0/926663481 learned_addr learned my addr 172.21.15.106:0/926663481 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e9252700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e415e160 0x7fb0e4153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e8a51700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 0x7fb0e415ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 -- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 msgr2=0x7fb0e415ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 0x7fb0e415ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 -- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e415e160 msgr2=0x7fb0e4153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e415e160 0x7fb0e4153c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 -- 172.21.15.106:0/926663481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d00094a0 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e8a51700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 0x7fb0e415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e3fff700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00097c0 tx=0x7fb0d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d00045f0 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d001f070 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0003b00 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0e40b06d0 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.731+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0e40b0c90 con 0x7fb0e40afc90 2023-11-24T06:14:37.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.732+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0e4068fb0 con 0x7fb0e40afc90 2023-11-24T06:14:37.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.733+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0d0003c60 con 0x7fb0e40afc90 2023-11-24T06:14:37.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.733+0000 7fb0e17fa700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 0x7fb0c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:37.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.733+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0d0021070 con 0x7fb0e40afc90 2023-11-24T06:14:37.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.733+0000 7fb0e8a51700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 0x7fb0c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:37.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.733+0000 7fb0e8a51700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 0x7fb0c806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0e415d210 tx=0x7fb0d8008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:37.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.737+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb0d0056140 con 0x7fb0e40afc90 2023-11-24T06:14:37.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:37.974+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb0e406c140 con 0x7fb0e40afc90 2023-11-24T06:14:38.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.900+0000 7fb0e17fa700 1 -- 172.21.15.106:0/926663481 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb0d002b0b0 con 0x7fb0e40afc90 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 msgr2=0x7fb0c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 0x7fb0c806d390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb0e415d210 tx=0x7fb0d8008040 comp rx=0 tx=0).stop 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 msgr2=0x7fb0e414c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb0d00097c0 tx=0x7fb0d0004750 comp rx=0 tx=0).stop 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 shutdown_connections 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb0c806aed0 0x7fb0c806d390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb0e415e160 0x7fb0e4153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb0e40744d0 0x7fb0e415ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 --2- 172.21.15.106:0/926663481 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb0e40afc90 0x7fb0e414c8e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:38.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 >> 172.21.15.106:0/926663481 conn(0x7fb0e40d0bf0 msgr2=0x7fb0e40aeac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:38.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 shutdown_connections 2023-11-24T06:14:38.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:38.903+0000 7fb0eacb5700 1 -- 172.21.15.106:0/926663481 wait complete. 2023-11-24T06:14:38.919 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-24T06:14:38.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-24T06:14:39.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.041+0000 7f0a3190a700 1 Processor -- start 2023-11-24T06:14:39.044 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.041+0000 7f0a3190a700 1 -- start start 2023-11-24T06:14:39.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a3190a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 0x7f0a2c0d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a3190a700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0a2c071d20 0x7f0a2c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a3190a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0d2a60 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a3190a700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0d2d40 con 0x7f0a2c071d20 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a3190a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0d3020 con 0x7f0a2c15e090 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a2a7fc700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7f0a2c0d24e0 0x7f0a2c071610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:34202/0 (socket says 172.21.15.106:34202) 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.042+0000 7f0a2a7fc700 1 -- 172.21.15.106:0/3715706983 learned_addr learned my addr 172.21.15.106:0/3715706983 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683444573 0 0) 0x7f0a2c0d2a60 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a140035b0 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2b7fe700 1 --2- 172.21.15.106:0/3715706983 >> v2:172.21.15.176:3300/0 conn(0x7f0a2c071d20 0x7f0a2c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 0x7f0a2c0d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.1 v1:172.21.15.176:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443429726 0 0) 0x7f0a140035b0 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 msgr2=0x7f0a2c0d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 0x7f0a2c0d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 >> v2:172.21.15.176:3300/0 conn(0x7f0a2c071d20 msgr2=0x7f0a2c0b6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 --2- 172.21.15.106:0/3715706983 >> v2:172.21.15.176:3300/0 conn(0x7f0a2c071d20 0x7f0a2c0b6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 --> v1:172.21.15.176:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0d3300 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.1 v1:172.21.15.176:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f0a1c001670 con 0x7f0a2c0d24e0 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 >> v1:172.21.15.176:6789/0 conn(0x7f0a2c0d24e0 legacy=0x7f0a2c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a14003a00 0x7f0a14003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a14004850 0x7f0a14004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 0x7f0a14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0d2d40 con 0x7f0a14003a00 2023-11-24T06:14:39.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0d3020 con 0x7f0a14004850 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a1400bb50 con 0x7f0a2c15e090 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a14003a00 0x7f0a14003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 -- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 msgr2=0x7f0a14005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a2c15e090 0x7f0a14005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 -- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a14004850 msgr2=0x7f0a14004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.043+0000 7f0a2affd700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a14004850 0x7f0a14004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a2affd700 1 -- 172.21.15.106:0/3715706983 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a140035b0 con 0x7f0a14003a00 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a2affd700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a14003a00 0x7f0a14003e20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009860 tx=0x7f0a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eace50ae72f060ee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2000c070 con 0x7f0a14003a00 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a20013610 con 0x7f0a14003a00 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a29ffb700 1 -- 172.21.15.106:0/3715706983 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200139a0 con 0x7f0a14003a00 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 -- 172.21.15.106:0/3715706983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a14003a00 msgr2=0x7f0a14003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 --2- 172.21.15.106:0/3715706983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a14003a00 0x7f0a14003e20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009860 tx=0x7f0a14005880 comp rx=0 tx=0).stop 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a2b7fe700 1 -- 172.21.15.106:0/3715706983 reap_dead start 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 -- 172.21.15.106:0/3715706983 shutdown_connections 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 -- 172.21.15.106:0/3715706983 >> 172.21.15.106:0/3715706983 conn(0x7f0a2c06b410 msgr2=0x7f0a2c06b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 -- 172.21.15.106:0/3715706983 shutdown_connections 2023-11-24T06:14:39.051 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.044+0000 7f0a3190a700 1 -- 172.21.15.106:0/3715706983 wait complete. 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 Processor -- start 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 -- start start 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a14003a00 0x7f0a2c156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a2c147a90 0x7f0a2c0ce890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c153e70 con 0x7f0a2c1540c0 2023-11-24T06:14:39.054 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c158ec0 con 0x7f0a2c147a90 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.046+0000 7f0a3190a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c1591a0 con 0x7f0a14003a00 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59710/0 (socket says 172.21.15.106:59710) 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 -- 172.21.15.106:0/1632927910 learned_addr learned my addr 172.21.15.106:0/1632927910 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2affd700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a14003a00 0x7f0a2c156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2a7fc700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a2c147a90 0x7f0a2c0ce890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 -- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a14003a00 msgr2=0x7f0a2c156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a14003a00 0x7f0a2c156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 -- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a2c147a90 msgr2=0x7f0a2c0ce890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a2c147a90 0x7f0a2c0ce890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 -- 172.21.15.106:0/1632927910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0d3c80 con 0x7f0a2c1540c0 2023-11-24T06:14:39.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a2b7fe700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b6a90 tx=0x7f0a24009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2400ea10 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2400eb90 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c159480 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24014420 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.047+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c157360 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.048+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c1597b0 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.049+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0a24003a20 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.049+0000 7f0a13fff700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 0x7f0a1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.049+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a240894e0 con 0x7f0a2c1540c0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.049+0000 7f0a2affd700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 0x7f0a1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:39.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.050+0000 7f0a2affd700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 0x7f0a1806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a20016040 tx=0x7f0a2001f040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:39.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.054+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0a24054620 con 0x7f0a2c1540c0 2023-11-24T06:14:39.293 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.290+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f0a2c068fb0 con 0x7f0a2c1540c0 2023-11-24T06:14:39.427 INFO:tasks.ceph.mds.b.smithi176.stderr:2023-11-24T06:14:39.424+0000 7f501c370700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:14:39.763 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:39.766 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:14:39.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.901+0000 7f0a13fff700 1 -- 172.21.15.106:0/1632927910 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0a2405e070 con 0x7f0a2c1540c0 2023-11-24T06:14:39.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 msgr2=0x7f0a1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 0x7f0a1806d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0a20016040 tx=0x7f0a2001f040 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 msgr2=0x7f0a2c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b6a90 tx=0x7f0a24009ee0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 shutdown_connections 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f0a1806aed0 0x7f0a1806d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2c1540c0 0x7f0a2c0b4cf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f0a14003a00 0x7f0a2c156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 --2- 172.21.15.106:0/1632927910 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0a2c147a90 0x7f0a2c0ce890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 >> 172.21.15.106:0/1632927910 conn(0x7f0a2c06b410 msgr2=0x7f0a2c0d1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 shutdown_connections 2023-11-24T06:14:39.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:39.904+0000 7f0a3190a700 1 -- 172.21.15.106:0/1632927910 wait complete. 2023-11-24T06:14:39.919 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-24T06:14:39.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:40.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 Processor -- start 2023-11-24T06:14:40.039 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 -- start start 2023-11-24T06:14:40.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f815e080 0x7fe3f80b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.041 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806c710 0x7fe3f80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3f80ae430 con 0x7fe3f80af4d0 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3f80af0b0 con 0x7fe3f806c710 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.037+0000 7fe3fe54f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f80b05a0 con 0x7fe3f815e080 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806c710 0x7fe3f80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3f806c710 0x7fe3f80afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59718/0 (socket says 172.21.15.106:59718) 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 -- 172.21.15.106:0/816115941 learned_addr learned my addr 172.21.15.106:0/816115941 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 -- 172.21.15.106:0/816115941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f815e080 msgr2=0x7fe3f80b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 --2- 172.21.15.106:0/816115941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f815e080 0x7fe3f80b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 -- 172.21.15.106:0/816115941 >> v1:172.21.15.176:6789/0 conn(0x7fe3f80af4d0 legacy=0x7fe3f806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 -- 172.21.15.106:0/816115941 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f80ae710 con 0x7fe3f806c710 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3fcaec700 1 --2- 172.21.15.106:0/816115941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806c710 0x7fe3f80afb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e80 tx=0x7fe3f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7418fc4f58575cd0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.042 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3f6ffd700 1 -- 172.21.15.106:0/816115941 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000e070 con 0x7fe3f806c710 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3f6ffd700 1 -- 172.21.15.106:0/816115941 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f0003a20 con 0x7fe3f806c710 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.038+0000 7fe3f6ffd700 1 -- 172.21.15.106:0/816115941 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0003dd0 con 0x7fe3f806c710 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 -- 172.21.15.106:0/816115941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806c710 msgr2=0x7fe3f80afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/816115941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806c710 0x7fe3f80afb90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009e80 tx=0x7fe3f000b330 comp rx=0 tx=0).stop 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 -- 172.21.15.106:0/816115941 shutdown_connections 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/816115941 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f815e080 0x7fe3f80b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/816115941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f806c710 0x7fe3f80afb90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 -- 172.21.15.106:0/816115941 >> 172.21.15.106:0/816115941 conn(0x7fe3f8071b90 msgr2=0x7fe3f8071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 -- 172.21.15.106:0/816115941 shutdown_connections 2023-11-24T06:14:40.043 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.039+0000 7fe3fe54f700 1 -- 172.21.15.106:0/816115941 wait complete. 2023-11-24T06:14:40.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.040+0000 7fe3fe54f700 1 Processor -- start 2023-11-24T06:14:40.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.040+0000 7fe3fe54f700 1 -- start start 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3f806c710 0x7fe3f8156b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f80af4d0 0x7fe3f814a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f81539b0 con 0x7fe3f815e080 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f814a9f0 con 0x7fe3f806c710 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fe54f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3f8159180 con 0x7fe3f80af4d0 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59724/0 (socket says 172.21.15.106:59724) 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 -- 172.21.15.106:0/30442296 learned_addr learned my addr 172.21.15.106:0/30442296 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3f77fe700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f80af4d0 0x7fe3f814a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3f7fff700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3f806c710 0x7fe3f8156b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 -- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f80af4d0 msgr2=0x7fe3f814a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f80af4d0 0x7fe3f814a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 -- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3f806c710 msgr2=0x7fe3f8156b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3f806c710 0x7fe3f8156b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 -- 172.21.15.106:0/30442296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f0009b30 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.041+0000 7fe3fcaec700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0015040 tx=0x7fe3f0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.042+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004440 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.042+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f00045c0 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.042+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f8154b40 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.042+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f0004970 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.042+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f8155100 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.043+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3f80753f0 con 0x7fe3f815e080 2023-11-24T06:14:40.047 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.043+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe3f0012430 con 0x7fe3f815e080 2023-11-24T06:14:40.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.043+0000 7fe3f4ff9700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 0x7fe3e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.044+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3f008a960 con 0x7fe3f815e080 2023-11-24T06:14:40.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.044+0000 7fe3f7fff700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 0x7fe3e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.048 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.044+0000 7fe3f7fff700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 0x7fe3e406d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009970 tx=0x7fe3e8009110 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.048+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe3f0059530 con 0x7fe3f815e080 2023-11-24T06:14:40.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.283+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe3f806e590 con 0x7fe3f815e080 2023-11-24T06:14:40.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.283+0000 7fe3f4ff9700 1 -- 172.21.15.106:0/30442296 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fe3f0017090 con 0x7fe3f815e080 2023-11-24T06:14:40.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:40.287 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 msgr2=0x7fe3e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 0x7fe3e406d390 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe3e8009970 tx=0x7fe3e8009110 comp rx=0 tx=0).stop 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 msgr2=0x7fe3f8159990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0015040 tx=0x7fe3f0004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 shutdown_connections 2023-11-24T06:14:40.289 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe3e406aed0 0x7fe3e406d390 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3f815e080 0x7fe3f8159990 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3f806c710 0x7fe3f8156b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 --2- 172.21.15.106:0/30442296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3f80af4d0 0x7fe3f814a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 >> 172.21.15.106:0/30442296 conn(0x7fe3f8071b90 msgr2=0x7fe3f80b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 shutdown_connections 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.286+0000 7fe3fe54f700 1 -- 172.21.15.106:0/30442296 wait complete. 2023-11-24T06:14:40.290 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 17 2023-11-24T06:14:40.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:40.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.418+0000 7fde4363f700 1 Processor -- start 2023-11-24T06:14:40.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.418+0000 7fde4363f700 1 -- start start 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde4363f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde3c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde4363f700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0b22d0 con 0x7fde3c0d1c70 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde4363f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3c0b25b0 con 0x7fde3c0b3370 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde4363f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b2f50 con 0x7fde3c15bdd0 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde41bdc700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fde3c0d1c70 0x7fde3c165ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39994/0 (socket says 172.21.15.106:39994) 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde41bdc700 1 -- 172.21.15.106:0/3457650846 learned_addr learned my addr 172.21.15.106:0/3457650846 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde413db700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde3c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1734797816 0 0) 0x7fde3c0b22d0 con 0x7fde3c0d1c70 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde280035b0 con 0x7fde3c0d1c70 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675972094 0 0) 0x7fde280035b0 con 0x7fde3c0d1c70 2023-11-24T06:14:40.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 msgr2=0x7fde3c1604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde3c1604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 >> v1:172.21.15.176:6789/0 conn(0x7fde3c0b3370 legacy=0x7fde3c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c0b2890 con 0x7fde3c0d1c70 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.419+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fde340019f0 con 0x7fde3c0d1c70 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 >> v1:172.21.15.106:6789/0 conn(0x7fde3c0d1c70 legacy=0x7fde3c165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde28003a30 0x7fde28003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde28004850 0x7fde28004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde28005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b2f50 con 0x7fde28004850 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde2800fed0 con 0x7fde28003a30 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde28010090 con 0x7fde3c15bdd0 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde28004850 0x7fde28004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde41bdc700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde28005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde413db700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde28003a30 0x7fde28003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 -- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 msgr2=0x7fde28005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c15bdd0 0x7fde28005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 -- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde28003a30 msgr2=0x7fde28003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde28003a30 0x7fde28003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 -- 172.21.15.106:0/3457650846 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280035b0 con 0x7fde28004850 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde40bda700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde28004850 0x7fde28004cd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde2c012da0 tx=0x7fde28005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18385d91d857f00 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c017070 con 0x7fde28004850 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2c012e90 con 0x7fde28004850 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.420+0000 7fde33fff700 1 -- 172.21.15.106:0/3457650846 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2c012910 con 0x7fde28004850 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 -- 172.21.15.106:0/3457650846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde28004850 msgr2=0x7fde28004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 --2- 172.21.15.106:0/3457650846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde28004850 0x7fde28004cd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fde2c012da0 tx=0x7fde28005880 comp rx=0 tx=0).stop 2023-11-24T06:14:40.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde41bdc700 1 -- 172.21.15.106:0/3457650846 reap_dead start 2023-11-24T06:14:40.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 -- 172.21.15.106:0/3457650846 shutdown_connections 2023-11-24T06:14:40.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 -- 172.21.15.106:0/3457650846 >> 172.21.15.106:0/3457650846 conn(0x7fde3c0731a0 msgr2=0x7fde3c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 -- 172.21.15.106:0/3457650846 shutdown_connections 2023-11-24T06:14:40.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.421+0000 7fde4363f700 1 -- 172.21.15.106:0/3457650846 wait complete. 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.422+0000 7fde4363f700 1 Processor -- start 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.422+0000 7fde4363f700 1 -- start start 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c151fe0 0x7fde3c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3c0b4ae0 0x7fde3c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c0b54a0 con 0x7fde3c159050 2023-11-24T06:14:40.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c1532b0 con 0x7fde3c0b4ae0 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde4363f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c155700 con 0x7fde3c151fe0 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59744/0 (socket says 172.21.15.106:59744) 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 -- 172.21.15.106:0/1089499906 learned_addr learned my addr 172.21.15.106:0/1089499906 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde413db700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c151fe0 0x7fde3c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde40bda700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3c0b4ae0 0x7fde3c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 -- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c151fe0 msgr2=0x7fde3c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c151fe0 0x7fde3c1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 -- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3c0b4ae0 msgr2=0x7fde3c0b4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3c0b4ae0 0x7fde3c0b4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 -- 172.21.15.106:0/1089499906 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c15a340 con 0x7fde3c159050 2023-11-24T06:14:40.431 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.423+0000 7fde41bdc700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0d06d0 tx=0x7fde3400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.424+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3400ad00 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.424+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3400ae80 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.424+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde3c15a620 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.424+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34013630 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.424+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde3c153500 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.425+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde3c1536c0 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.425+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde34013790 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.425+0000 7fde31ffb700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 0x7fde2006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.425+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde34089d10 con 0x7fde3c159050 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.426+0000 7fde413db700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 0x7fde2006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.426+0000 7fde413db700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 0x7fde2006d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0b78d0 tx=0x7fde38009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.430+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde34054e50 con 0x7fde3c159050 2023-11-24T06:14:40.625 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.623+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde3c067f60 con 0x7fde3c159050 2023-11-24T06:14:40.626 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.624+0000 7fde31ffb700 1 -- 172.21.15.106:0/1089499906 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fde34058470 con 0x7fde3c159050 2023-11-24T06:14:40.627 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:40.627 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:40.629 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 msgr2=0x7fde2006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 0x7fde2006d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0b78d0 tx=0x7fde38009210 comp rx=0 tx=0).stop 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 msgr2=0x7fde3c1594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0d06d0 tx=0x7fde3400a5f0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 shutdown_connections 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fde2006aed0 0x7fde2006d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde3c159050 0x7fde3c1594e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fde3c151fe0 0x7fde3c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 --2- 172.21.15.106:0/1089499906 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fde3c0b4ae0 0x7fde3c0b4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 >> 172.21.15.106:0/1089499906 conn(0x7fde3c0731a0 msgr2=0x7fde3c157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 shutdown_connections 2023-11-24T06:14:40.631 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.626+0000 7fde4363f700 1 -- 172.21.15.106:0/1089499906 wait complete. 2023-11-24T06:14:40.641 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-24T06:14:40.642 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:40.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.758+0000 7f8a2eed6700 1 Processor -- start 2023-11-24T06:14:40.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 -- start start 2023-11-24T06:14:40.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a2815bdd0 0x7f8a281604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8a280d1c70 0x7f8a280d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a280b22d0 con 0x7f8a280b3370 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a280b2f50 con 0x7f8a2815bdd0 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2eed6700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a280d2640 con 0x7f8a280d1c70 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.759+0000 7f8a2cc72700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a2815bdd0 0x7f8a281604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a2815bdd0 0x7f8a281604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59748/0 (socket says 172.21.15.106:59748) 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 -- 172.21.15.106:0/4176630440 learned_addr learned my addr 172.21.15.106:0/4176630440 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2d473700 1 --2- 172.21.15.106:0/4176630440 >> v2:172.21.15.176:3300/0 conn(0x7f8a280d1c70 0x7f8a280d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 -- 172.21.15.106:0/4176630440 >> v2:172.21.15.176:3300/0 conn(0x7f8a280d1c70 msgr2=0x7f8a280d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/4176630440 >> v2:172.21.15.176:3300/0 conn(0x7f8a280d1c70 0x7f8a280d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 -- 172.21.15.106:0/4176630440 >> v1:172.21.15.176:6789/0 conn(0x7f8a280b3370 legacy=0x7f8a280b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 -- 172.21.15.106:0/4176630440 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a280b25b0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/4176630440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a281604e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8a28160a50 tx=0x7f8a1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c6c3ce43a72f6c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a277fe700 1 -- 172.21.15.106:0/4176630440 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00b870 con 0x7f8a2815bdd0 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a277fe700 1 -- 172.21.15.106:0/4176630440 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c00b9d0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.760+0000 7f8a277fe700 1 -- 172.21.15.106:0/4176630440 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c00bd60 con 0x7f8a2815bdd0 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 -- 172.21.15.106:0/4176630440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 msgr2=0x7f8a281604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/4176630440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a281604e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8a28160a50 tx=0x7f8a1c009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 -- 172.21.15.106:0/4176630440 shutdown_connections 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/4176630440 >> v2:172.21.15.176:3300/0 conn(0x7f8a280d1c70 0x7f8a280d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/4176630440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a281604e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 -- 172.21.15.106:0/4176630440 >> 172.21.15.106:0/4176630440 conn(0x7f8a280731a0 msgr2=0x7f8a2809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 -- 172.21.15.106:0/4176630440 shutdown_connections 2023-11-24T06:14:40.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.761+0000 7f8a2eed6700 1 -- 172.21.15.106:0/4176630440 wait complete. 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.762+0000 7f8a2eed6700 1 Processor -- start 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.762+0000 7f8a2eed6700 1 -- start start 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 0x7f8a2806c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a280d1c70 0x7f8a281e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a281e75c0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a28157590 con 0x7f8a280d1c70 2023-11-24T06:14:40.768 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2eed6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2806c9d0 con 0x7f8a280b3370 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59756/0 (socket says 172.21.15.106:59756) 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 -- 172.21.15.106:0/83681927 learned_addr learned my addr 172.21.15.106:0/83681927 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 0x7f8a2806c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a27fff700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a280d1c70 0x7f8a281e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 -- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 msgr2=0x7f8a2806c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 0x7f8a2806c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 -- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a280d1c70 msgr2=0x7f8a281e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a280d1c70 0x7f8a281e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 -- 172.21.15.106:0/83681927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009550 con 0x7f8a2815bdd0 2023-11-24T06:14:40.769 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 0x7f8a2806c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a2d473700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a20007e40 tx=0x7f8a2000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.763+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2000ede0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.764+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a20014420 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.764+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2806ccb0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.764+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a200147d0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.764+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a281e71e0 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.764+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a281e7700 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.765+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a20014930 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.765+0000 7f8a257fa700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 0x7f8a0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.765+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a20089c50 con 0x7f8a2815bdd0 2023-11-24T06:14:40.770 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.765+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 0x7f8a0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:40.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.766+0000 7f8a2cc72700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 0x7f8a0c06d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c014040 tx=0x7f8a1c008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:40.773 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.770+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a281e7700 con 0x7f8a2815bdd0 2023-11-24T06:14:40.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.959+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a280b2b70 con 0x7f8a0c06aed0 2023-11-24T06:14:40.970 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.967+0000 7f8a257fa700 1 -- 172.21.15.106:0/83681927 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288683 (secure 0 0 0) 0x7f8a1c00bbc0 con 0x7f8a0c06aed0 2023-11-24T06:14:40.973 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 msgr2=0x7f8a0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 0x7f8a0c06d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c014040 tx=0x7f8a1c008030 comp rx=0 tx=0).stop 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 msgr2=0x7f8a28157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a20007e40 tx=0x7f8a2000e3c0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 shutdown_connections 2023-11-24T06:14:40.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8a0c06aed0 0x7f8a0c06d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a2815bdd0 0x7f8a28157050 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8a280b3370 0x7f8a2806c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 --2- 172.21.15.106:0/83681927 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8a280d1c70 0x7f8a281e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 >> 172.21.15.106:0/83681927 conn(0x7f8a280731a0 msgr2=0x7f8a2815aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 shutdown_connections 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:40.971+0000 7f8a2eed6700 1 -- 172.21.15.106:0/83681927 wait complete. 2023-11-24T06:14:40.977 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:14:40.985 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-11-24T06:14:39.699775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220192,"kb_used_data":3996,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754528,"statfs":{"total":773094113280,"available":772868636672,"internally_reserved":0,"allocated":4091904,"data_stored":2304796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.152274"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622260+0000","last_change":"2023-11-24T06:14:36.581911+0000","last_active":"2023-11-24T06:14:37.622260+0000","last_peered":"2023-11-24T06:14:37.622260+0000","last_clean":"2023-11-24T06:14:37.622260+0000","last_became_active":"2023-11-24T06:14:36.581592+0000","last_became_peered":"2023-11-24T06:14:36.581592+0000","last_unstale":"2023-11-24T06:14:37.622260+0000","last_undegraded":"2023-11-24T06:14:37.622260+0000","last_fullsized":"2023-11-24T06:14:37.622260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:37.988314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622319+0000","last_change":"2023-11-24T06:14:36.576331+0000","last_active":"2023-11-24T06:14:37.622319+0000","last_peered":"2023-11-24T06:14:37.622319+0000","last_clean":"2023-11-24T06:14:37.622319+0000","last_became_active":"2023-11-24T06:14:36.576017+0000","last_became_peered":"2023-11-24T06:14:36.576017+0000","last_unstale":"2023-11-24T06:14:37.622319+0000","last_undegraded":"2023-11-24T06:14:37.622319+0000","last_fullsized":"2023-11-24T06:14:37.622319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:56:45.154769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622882+0000","last_change":"2023-11-24T06:14:36.584449+0000","last_active":"2023-11-24T06:14:37.622882+0000","last_peered":"2023-11-24T06:14:37.622882+0000","last_clean":"2023-11-24T06:14:37.622882+0000","last_became_active":"2023-11-24T06:14:36.584134+0000","last_became_peered":"2023-11-24T06:14:36.584134+0000","last_unstale":"2023-11-24T06:14:37.622882+0000","last_undegraded":"2023-11-24T06:14:37.622882+0000","last_fullsized":"2023-11-24T06:14:37.622882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:28.657968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561917+0000","last_change":"2023-11-24T06:14:36.578484+0000","last_active":"2023-11-24T06:14:37.561917+0000","last_peered":"2023-11-24T06:14:37.561917+0000","last_clean":"2023-11-24T06:14:37.561917+0000","last_became_active":"2023-11-24T06:14:36.578058+0000","last_became_peered":"2023-11-24T06:14:36.578058+0000","last_unstale":"2023-11-24T06:14:37.561917+0000","last_undegraded":"2023-11-24T06:14:37.561917+0000","last_fullsized":"2023-11-24T06:14:37.561917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:15.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621310+0000","last_change":"2023-11-24T06:14:36.569434+0000","last_active":"2023-11-24T06:14:37.621310+0000","last_peered":"2023-11-24T06:14:37.621310+0000","last_clean":"2023-11-24T06:14:37.621310+0000","last_became_active":"2023-11-24T06:14:36.569184+0000","last_became_peered":"2023-11-24T06:14:36.569184+0000","last_unstale":"2023-11-24T06:14:37.621310+0000","last_undegraded":"2023-11-24T06:14:37.621310+0000","last_fullsized":"2023-11-24T06:14:37.621310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:15.027925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621826+0000","last_change":"2023-11-24T06:14:36.581830+0000","last_active":"2023-11-24T06:14:37.621826+0000","last_peered":"2023-11-24T06:14:37.621826+0000","last_clean":"2023-11-24T06:14:37.621826+0000","last_became_active":"2023-11-24T06:14:36.581611+0000","last_became_peered":"2023-11-24T06:14:36.581611+0000","last_unstale":"2023-11-24T06:14:37.621826+0000","last_undegraded":"2023-11-24T06:14:37.621826+0000","last_fullsized":"2023-11-24T06:14:37.621826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622119+0000","last_change":"2023-11-24T06:14:36.573120+0000","last_active":"2023-11-24T06:14:37.622119+0000","last_peered":"2023-11-24T06:14:37.622119+0000","last_clean":"2023-11-24T06:14:37.622119+0000","last_became_active":"2023-11-24T06:14:36.572741+0000","last_became_peered":"2023-11-24T06:14:36.572741+0000","last_unstale":"2023-11-24T06:14:37.622119+0000","last_undegraded":"2023-11-24T06:14:37.622119+0000","last_fullsized":"2023-11-24T06:14:37.622119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:21.725087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622216+0000","last_change":"2023-11-24T06:14:36.575597+0000","last_active":"2023-11-24T06:14:37.622216+0000","last_peered":"2023-11-24T06:14:37.622216+0000","last_clean":"2023-11-24T06:14:37.622216+0000","last_became_active":"2023-11-24T06:14:36.575317+0000","last_became_peered":"2023-11-24T06:14:36.575317+0000","last_unstale":"2023-11-24T06:14:37.622216+0000","last_undegraded":"2023-11-24T06:14:37.622216+0000","last_fullsized":"2023-11-24T06:14:37.622216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563878+0000","last_change":"2023-11-24T06:14:36.574582+0000","last_active":"2023-11-24T06:14:37.563878+0000","last_peered":"2023-11-24T06:14:37.563878+0000","last_clean":"2023-11-24T06:14:37.563878+0000","last_became_active":"2023-11-24T06:14:36.573348+0000","last_became_peered":"2023-11-24T06:14:36.573348+0000","last_unstale":"2023-11-24T06:14:37.563878+0000","last_undegraded":"2023-11-24T06:14:37.563878+0000","last_fullsized":"2023-11-24T06:14:37.563878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562613+0000","last_change":"2023-11-24T06:14:36.575451+0000","last_active":"2023-11-24T06:14:37.562613+0000","last_peered":"2023-11-24T06:14:37.562613+0000","last_clean":"2023-11-24T06:14:37.562613+0000","last_became_active":"2023-11-24T06:14:36.574687+0000","last_became_peered":"2023-11-24T06:14:36.574687+0000","last_unstale":"2023-11-24T06:14:37.562613+0000","last_undegraded":"2023-11-24T06:14:37.562613+0000","last_fullsized":"2023-11-24T06:14:37.562613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:21.725087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623005+0000","last_change":"2023-11-24T06:14:36.579431+0000","last_active":"2023-11-24T06:14:37.623005+0000","last_peered":"2023-11-24T06:14:37.623005+0000","last_clean":"2023-11-24T06:14:37.623005+0000","last_became_active":"2023-11-24T06:14:36.579120+0000","last_became_peered":"2023-11-24T06:14:36.579120+0000","last_unstale":"2023-11-24T06:14:37.623005+0000","last_undegraded":"2023-11-24T06:14:37.623005+0000","last_fullsized":"2023-11-24T06:14:37.623005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622849+0000","last_change":"2023-11-24T06:14:36.580965+0000","last_active":"2023-11-24T06:14:37.622849+0000","last_peered":"2023-11-24T06:14:37.622849+0000","last_clean":"2023-11-24T06:14:37.622849+0000","last_became_active":"2023-11-24T06:14:36.580703+0000","last_became_peered":"2023-11-24T06:14:36.580703+0000","last_unstale":"2023-11-24T06:14:37.622849+0000","last_undegraded":"2023-11-24T06:14:37.622849+0000","last_fullsized":"2023-11-24T06:14:37.622849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621413+0000","last_change":"2023-11-24T06:14:36.573662+0000","last_active":"2023-11-24T06:14:37.621413+0000","last_peered":"2023-11-24T06:14:37.621413+0000","last_clean":"2023-11-24T06:14:37.621413+0000","last_became_active":"2023-11-24T06:14:36.573373+0000","last_became_peered":"2023-11-24T06:14:36.573373+0000","last_unstale":"2023-11-24T06:14:37.621413+0000","last_undegraded":"2023-11-24T06:14:37.621413+0000","last_fullsized":"2023-11-24T06:14:37.621413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:27:19.360985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621971+0000","last_change":"2023-11-24T06:14:36.569393+0000","last_active":"2023-11-24T06:14:37.621971+0000","last_peered":"2023-11-24T06:14:37.621971+0000","last_clean":"2023-11-24T06:14:37.621971+0000","last_became_active":"2023-11-24T06:14:36.569128+0000","last_became_peered":"2023-11-24T06:14:36.569128+0000","last_unstale":"2023-11-24T06:14:37.621971+0000","last_undegraded":"2023-11-24T06:14:37.621971+0000","last_fullsized":"2023-11-24T06:14:37.621971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622013+0000","last_change":"2023-11-24T06:14:36.576242+0000","last_active":"2023-11-24T06:14:37.622013+0000","last_peered":"2023-11-24T06:14:37.622013+0000","last_clean":"2023-11-24T06:14:37.622013+0000","last_became_active":"2023-11-24T06:14:36.575969+0000","last_became_peered":"2023-11-24T06:14:36.575969+0000","last_unstale":"2023-11-24T06:14:37.622013+0000","last_undegraded":"2023-11-24T06:14:37.622013+0000","last_fullsized":"2023-11-24T06:14:37.622013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622398+0000","last_change":"2023-11-24T06:14:36.579132+0000","last_active":"2023-11-24T06:14:37.622398+0000","last_peered":"2023-11-24T06:14:37.622398+0000","last_clean":"2023-11-24T06:14:37.622398+0000","last_became_active":"2023-11-24T06:14:36.578948+0000","last_became_peered":"2023-11-24T06:14:36.578948+0000","last_unstale":"2023-11-24T06:14:37.622398+0000","last_undegraded":"2023-11-24T06:14:37.622398+0000","last_fullsized":"2023-11-24T06:14:37.622398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:58.774787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622800+0000","last_change":"2023-11-24T06:14:36.574268+0000","last_active":"2023-11-24T06:14:37.622800+0000","last_peered":"2023-11-24T06:14:37.622800+0000","last_clean":"2023-11-24T06:14:37.622800+0000","last_became_active":"2023-11-24T06:14:36.572883+0000","last_became_peered":"2023-11-24T06:14:36.572883+0000","last_unstale":"2023-11-24T06:14:37.622800+0000","last_undegraded":"2023-11-24T06:14:37.622800+0000","last_fullsized":"2023-11-24T06:14:37.622800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622331+0000","last_change":"2023-11-24T06:14:36.573234+0000","last_active":"2023-11-24T06:14:37.622331+0000","last_peered":"2023-11-24T06:14:37.622331+0000","last_clean":"2023-11-24T06:14:37.622331+0000","last_became_active":"2023-11-24T06:14:36.572991+0000","last_became_peered":"2023-11-24T06:14:36.572991+0000","last_unstale":"2023-11-24T06:14:37.622331+0000","last_undegraded":"2023-11-24T06:14:37.622331+0000","last_fullsized":"2023-11-24T06:14:37.622331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:11.984925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621842+0000","last_change":"2023-11-24T06:14:36.573341+0000","last_active":"2023-11-24T06:14:37.621842+0000","last_peered":"2023-11-24T06:14:37.621842+0000","last_clean":"2023-11-24T06:14:37.621842+0000","last_became_active":"2023-11-24T06:14:36.573014+0000","last_became_peered":"2023-11-24T06:14:36.573014+0000","last_unstale":"2023-11-24T06:14:37.621842+0000","last_undegraded":"2023-11-24T06:14:37.621842+0000","last_fullsized":"2023-11-24T06:14:37.621842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621340+0000","last_change":"2023-11-24T06:14:36.581876+0000","last_active":"2023-11-24T06:14:37.621340+0000","last_peered":"2023-11-24T06:14:37.621340+0000","last_clean":"2023-11-24T06:14:37.621340+0000","last_became_active":"2023-11-24T06:14:36.581637+0000","last_became_peered":"2023-11-24T06:14:36.581637+0000","last_unstale":"2023-11-24T06:14:37.621340+0000","last_undegraded":"2023-11-24T06:14:37.621340+0000","last_fullsized":"2023-11-24T06:14:37.621340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:11:00.748272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563838+0000","last_change":"2023-11-24T06:14:36.577270+0000","last_active":"2023-11-24T06:14:37.563838+0000","last_peered":"2023-11-24T06:14:37.563838+0000","last_clean":"2023-11-24T06:14:37.563838+0000","last_became_active":"2023-11-24T06:14:36.577001+0000","last_became_peered":"2023-11-24T06:14:36.577001+0000","last_unstale":"2023-11-24T06:14:37.563838+0000","last_undegraded":"2023-11-24T06:14:37.563838+0000","last_fullsized":"2023-11-24T06:14:37.563838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:45:29.958316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563372+0000","last_change":"2023-11-24T06:14:36.573759+0000","last_active":"2023-11-24T06:14:37.563372+0000","last_peered":"2023-11-24T06:14:37.563372+0000","last_clean":"2023-11-24T06:14:37.563372+0000","last_became_active":"2023-11-24T06:14:36.573495+0000","last_became_peered":"2023-11-24T06:14:36.573495+0000","last_unstale":"2023-11-24T06:14:37.563372+0000","last_undegraded":"2023-11-24T06:14:37.563372+0000","last_fullsized":"2023-11-24T06:14:37.563372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:42.895254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562974+0000","last_change":"2023-11-24T06:14:36.578992+0000","last_active":"2023-11-24T06:14:37.562974+0000","last_peered":"2023-11-24T06:14:37.562974+0000","last_clean":"2023-11-24T06:14:37.562974+0000","last_became_active":"2023-11-24T06:14:36.578697+0000","last_became_peered":"2023-11-24T06:14:36.578697+0000","last_unstale":"2023-11-24T06:14:37.562974+0000","last_undegraded":"2023-11-24T06:14:37.562974+0000","last_fullsized":"2023-11-24T06:14:37.562974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:51.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622650+0000","last_change":"2023-11-24T06:14:36.576646+0000","last_active":"2023-11-24T06:14:37.622650+0000","last_peered":"2023-11-24T06:14:37.622650+0000","last_clean":"2023-11-24T06:14:37.622650+0000","last_became_active":"2023-11-24T06:14:36.576386+0000","last_became_peered":"2023-11-24T06:14:36.576386+0000","last_unstale":"2023-11-24T06:14:37.622650+0000","last_undegraded":"2023-11-24T06:14:37.622650+0000","last_fullsized":"2023-11-24T06:14:37.622650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562661+0000","last_change":"2023-11-24T06:14:36.576230+0000","last_active":"2023-11-24T06:14:37.562661+0000","last_peered":"2023-11-24T06:14:37.562661+0000","last_clean":"2023-11-24T06:14:37.562661+0000","last_became_active":"2023-11-24T06:14:36.575971+0000","last_became_peered":"2023-11-24T06:14:36.575971+0000","last_unstale":"2023-11-24T06:14:37.562661+0000","last_undegraded":"2023-11-24T06:14:37.562661+0000","last_fullsized":"2023-11-24T06:14:37.562661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622397+0000","last_change":"2023-11-24T06:14:36.570228+0000","last_active":"2023-11-24T06:14:37.622397+0000","last_peered":"2023-11-24T06:14:37.622397+0000","last_clean":"2023-11-24T06:14:37.622397+0000","last_became_active":"2023-11-24T06:14:36.569907+0000","last_became_peered":"2023-11-24T06:14:36.569907+0000","last_unstale":"2023-11-24T06:14:37.622397+0000","last_undegraded":"2023-11-24T06:14:37.622397+0000","last_fullsized":"2023-11-24T06:14:37.622397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:26:12.878443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562457+0000","last_change":"2023-11-24T06:14:36.578188+0000","last_active":"2023-11-24T06:14:37.562457+0000","last_peered":"2023-11-24T06:14:37.562457+0000","last_clean":"2023-11-24T06:14:37.562457+0000","last_became_active":"2023-11-24T06:14:36.577908+0000","last_became_peered":"2023-11-24T06:14:36.577908+0000","last_unstale":"2023-11-24T06:14:37.562457+0000","last_undegraded":"2023-11-24T06:14:37.562457+0000","last_fullsized":"2023-11-24T06:14:37.562457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:30.726946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622400+0000","last_change":"2023-11-24T06:14:36.579751+0000","last_active":"2023-11-24T06:14:37.622400+0000","last_peered":"2023-11-24T06:14:37.622400+0000","last_clean":"2023-11-24T06:14:37.622400+0000","last_became_active":"2023-11-24T06:14:36.579460+0000","last_became_peered":"2023-11-24T06:14:36.579460+0000","last_unstale":"2023-11-24T06:14:37.622400+0000","last_undegraded":"2023-11-24T06:14:37.622400+0000","last_fullsized":"2023-11-24T06:14:37.622400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:58.774787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563219+0000","last_change":"2023-11-24T06:14:36.572754+0000","last_active":"2023-11-24T06:14:37.563219+0000","last_peered":"2023-11-24T06:14:37.563219+0000","last_clean":"2023-11-24T06:14:37.563219+0000","last_became_active":"2023-11-24T06:14:36.572469+0000","last_became_peered":"2023-11-24T06:14:36.572469+0000","last_unstale":"2023-11-24T06:14:37.563219+0000","last_undegraded":"2023-11-24T06:14:37.563219+0000","last_fullsized":"2023-11-24T06:14:37.563219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:59.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622424+0000","last_change":"2023-11-24T06:14:36.574036+0000","last_active":"2023-11-24T06:14:37.622424+0000","last_peered":"2023-11-24T06:14:37.622424+0000","last_clean":"2023-11-24T06:14:37.622424+0000","last_became_active":"2023-11-24T06:14:36.573724+0000","last_became_peered":"2023-11-24T06:14:36.573724+0000","last_unstale":"2023-11-24T06:14:37.622424+0000","last_undegraded":"2023-11-24T06:14:37.622424+0000","last_fullsized":"2023-11-24T06:14:37.622424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:28.657968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623112+0000","last_change":"2023-11-24T06:14:36.569379+0000","last_active":"2023-11-24T06:14:37.623112+0000","last_peered":"2023-11-24T06:14:37.623112+0000","last_clean":"2023-11-24T06:14:37.623112+0000","last_became_active":"2023-11-24T06:14:36.568881+0000","last_became_peered":"2023-11-24T06:14:36.568881+0000","last_unstale":"2023-11-24T06:14:37.623112+0000","last_undegraded":"2023-11-24T06:14:37.623112+0000","last_fullsized":"2023-11-24T06:14:37.623112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:42.895254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622862+0000","last_change":"2023-11-24T06:14:36.585094+0000","last_active":"2023-11-24T06:14:37.622862+0000","last_peered":"2023-11-24T06:14:37.622862+0000","last_clean":"2023-11-24T06:14:37.622862+0000","last_became_active":"2023-11-24T06:14:36.584811+0000","last_became_peered":"2023-11-24T06:14:36.584811+0000","last_unstale":"2023-11-24T06:14:37.622862+0000","last_undegraded":"2023-11-24T06:14:37.622862+0000","last_fullsized":"2023-11-24T06:14:37.622862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563246+0000","last_change":"2023-11-24T06:14:36.577475+0000","last_active":"2023-11-24T06:14:37.563246+0000","last_peered":"2023-11-24T06:14:37.563246+0000","last_clean":"2023-11-24T06:14:37.563246+0000","last_became_active":"2023-11-24T06:14:36.577190+0000","last_became_peered":"2023-11-24T06:14:36.577190+0000","last_unstale":"2023-11-24T06:14:37.563246+0000","last_undegraded":"2023-11-24T06:14:37.563246+0000","last_fullsized":"2023-11-24T06:14:37.563246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622519+0000","last_change":"2023-11-24T06:14:35.566892+0000","last_active":"2023-11-24T06:14:37.622519+0000","last_peered":"2023-11-24T06:14:37.622519+0000","last_clean":"2023-11-24T06:14:37.622519+0000","last_became_active":"2023-11-24T06:14:35.566644+0000","last_became_peered":"2023-11-24T06:14:35.566644+0000","last_unstale":"2023-11-24T06:14:37.622519+0000","last_undegraded":"2023-11-24T06:14:37.622519+0000","last_fullsized":"2023-11-24T06:14:37.622519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:36.039050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622420+0000","last_change":"2023-11-24T06:14:36.571140+0000","last_active":"2023-11-24T06:14:37.622420+0000","last_peered":"2023-11-24T06:14:37.622420+0000","last_clean":"2023-11-24T06:14:37.622420+0000","last_became_active":"2023-11-24T06:14:36.570840+0000","last_became_peered":"2023-11-24T06:14:36.570840+0000","last_unstale":"2023-11-24T06:14:37.622420+0000","last_undegraded":"2023-11-24T06:14:37.622420+0000","last_fullsized":"2023-11-24T06:14:37.622420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:11.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563293+0000","last_change":"2023-11-24T06:14:35.569574+0000","last_active":"2023-11-24T06:14:37.563293+0000","last_peered":"2023-11-24T06:14:37.563293+0000","last_clean":"2023-11-24T06:14:37.563293+0000","last_became_active":"2023-11-24T06:14:35.569320+0000","last_became_peered":"2023-11-24T06:14:35.569320+0000","last_unstale":"2023-11-24T06:14:37.563293+0000","last_undegraded":"2023-11-24T06:14:37.563293+0000","last_fullsized":"2023-11-24T06:14:37.563293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:36.981648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563469+0000","last_change":"2023-11-24T06:14:36.573148+0000","last_active":"2023-11-24T06:14:37.563469+0000","last_peered":"2023-11-24T06:14:37.563469+0000","last_clean":"2023-11-24T06:14:37.563469+0000","last_became_active":"2023-11-24T06:14:36.571850+0000","last_became_peered":"2023-11-24T06:14:36.571850+0000","last_unstale":"2023-11-24T06:14:37.563469+0000","last_undegraded":"2023-11-24T06:14:37.563469+0000","last_fullsized":"2023-11-24T06:14:37.563469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:51.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622192+0000","last_change":"2023-11-24T06:14:35.567271+0000","last_active":"2023-11-24T06:14:37.622192+0000","last_peered":"2023-11-24T06:14:37.622192+0000","last_clean":"2023-11-24T06:14:37.622192+0000","last_became_active":"2023-11-24T06:14:35.566902+0000","last_became_peered":"2023-11-24T06:14:35.566902+0000","last_unstale":"2023-11-24T06:14:37.622192+0000","last_undegraded":"2023-11-24T06:14:37.622192+0000","last_fullsized":"2023-11-24T06:14:37.622192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:26.171572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562435+0000","last_change":"2023-11-24T06:14:36.584365+0000","last_active":"2023-11-24T06:14:37.562435+0000","last_peered":"2023-11-24T06:14:37.562435+0000","last_clean":"2023-11-24T06:14:37.562435+0000","last_became_active":"2023-11-24T06:14:36.584130+0000","last_became_peered":"2023-11-24T06:14:36.584130+0000","last_unstale":"2023-11-24T06:14:37.562435+0000","last_undegraded":"2023-11-24T06:14:37.562435+0000","last_fullsized":"2023-11-24T06:14:37.562435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:27.178239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621431+0000","last_change":"2023-11-24T06:14:35.564827+0000","last_active":"2023-11-24T06:14:37.621431+0000","last_peered":"2023-11-24T06:14:37.621431+0000","last_clean":"2023-11-24T06:14:37.621431+0000","last_became_active":"2023-11-24T06:14:35.564586+0000","last_became_peered":"2023-11-24T06:14:35.564586+0000","last_unstale":"2023-11-24T06:14:37.621431+0000","last_undegraded":"2023-11-24T06:14:37.621431+0000","last_fullsized":"2023-11-24T06:14:37.621431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:35.764396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622708+0000","last_change":"2023-11-24T06:14:36.584649+0000","last_active":"2023-11-24T06:14:37.622708+0000","last_peered":"2023-11-24T06:14:37.622708+0000","last_clean":"2023-11-24T06:14:37.622708+0000","last_became_active":"2023-11-24T06:14:36.584368+0000","last_became_peered":"2023-11-24T06:14:36.584368+0000","last_unstale":"2023-11-24T06:14:37.622708+0000","last_undegraded":"2023-11-24T06:14:37.622708+0000","last_fullsized":"2023-11-24T06:14:37.622708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563337+0000","last_change":"2023-11-24T06:14:35.567610+0000","last_active":"2023-11-24T06:14:37.563337+0000","last_peered":"2023-11-24T06:14:37.563337+0000","last_clean":"2023-11-24T06:14:37.563337+0000","last_became_active":"2023-11-24T06:14:35.567334+0000","last_became_peered":"2023-11-24T06:14:35.567334+0000","last_unstale":"2023-11-24T06:14:37.563337+0000","last_undegraded":"2023-11-24T06:14:37.563337+0000","last_fullsized":"2023-11-24T06:14:37.563337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:35.956469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622104+0000","last_change":"2023-11-24T06:14:36.580145+0000","last_active":"2023-11-24T06:14:37.622104+0000","last_peered":"2023-11-24T06:14:37.622104+0000","last_clean":"2023-11-24T06:14:37.622104+0000","last_became_active":"2023-11-24T06:14:36.579505+0000","last_became_peered":"2023-11-24T06:14:36.579505+0000","last_unstale":"2023-11-24T06:14:37.622104+0000","last_undegraded":"2023-11-24T06:14:37.622104+0000","last_fullsized":"2023-11-24T06:14:37.622104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:31.953345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563386+0000","last_change":"2023-11-24T06:14:35.568375+0000","last_active":"2023-11-24T06:14:37.563386+0000","last_peered":"2023-11-24T06:14:37.563386+0000","last_clean":"2023-11-24T06:14:37.563386+0000","last_became_active":"2023-11-24T06:14:35.568118+0000","last_became_peered":"2023-11-24T06:14:35.568118+0000","last_unstale":"2023-11-24T06:14:37.563386+0000","last_undegraded":"2023-11-24T06:14:37.563386+0000","last_fullsized":"2023-11-24T06:14:37.563386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:59.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563461+0000","last_change":"2023-11-24T06:14:36.572248+0000","last_active":"2023-11-24T06:14:37.563461+0000","last_peered":"2023-11-24T06:14:37.563461+0000","last_clean":"2023-11-24T06:14:37.563461+0000","last_became_active":"2023-11-24T06:14:36.571957+0000","last_became_peered":"2023-11-24T06:14:36.571957+0000","last_unstale":"2023-11-24T06:14:37.563461+0000","last_undegraded":"2023-11-24T06:14:37.563461+0000","last_fullsized":"2023-11-24T06:14:37.563461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:55.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621657+0000","last_change":"2023-11-24T06:14:35.567224+0000","last_active":"2023-11-24T06:14:37.621657+0000","last_peered":"2023-11-24T06:14:37.621657+0000","last_clean":"2023-11-24T06:14:37.621657+0000","last_became_active":"2023-11-24T06:14:35.566960+0000","last_became_peered":"2023-11-24T06:14:35.566960+0000","last_unstale":"2023-11-24T06:14:37.621657+0000","last_undegraded":"2023-11-24T06:14:37.621657+0000","last_fullsized":"2023-11-24T06:14:37.621657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561773+0000","last_change":"2023-11-24T06:14:36.584514+0000","last_active":"2023-11-24T06:14:37.561773+0000","last_peered":"2023-11-24T06:14:37.561773+0000","last_clean":"2023-11-24T06:14:37.561773+0000","last_became_active":"2023-11-24T06:14:36.584284+0000","last_became_peered":"2023-11-24T06:14:36.584284+0000","last_unstale":"2023-11-24T06:14:37.561773+0000","last_undegraded":"2023-11-24T06:14:37.561773+0000","last_fullsized":"2023-11-24T06:14:37.561773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563413+0000","last_change":"2023-11-24T06:14:35.560626+0000","last_active":"2023-11-24T06:14:37.563413+0000","last_peered":"2023-11-24T06:14:37.563413+0000","last_clean":"2023-11-24T06:14:37.563413+0000","last_became_active":"2023-11-24T06:14:35.560354+0000","last_became_peered":"2023-11-24T06:14:35.560354+0000","last_unstale":"2023-11-24T06:14:37.563413+0000","last_undegraded":"2023-11-24T06:14:37.563413+0000","last_fullsized":"2023-11-24T06:14:37.563413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:26.281441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622700+0000","last_change":"2023-11-24T06:14:36.580739+0000","last_active":"2023-11-24T06:14:37.622700+0000","last_peered":"2023-11-24T06:14:37.622700+0000","last_clean":"2023-11-24T06:14:37.622700+0000","last_became_active":"2023-11-24T06:14:36.580484+0000","last_became_peered":"2023-11-24T06:14:36.580484+0000","last_unstale":"2023-11-24T06:14:37.622700+0000","last_undegraded":"2023-11-24T06:14:37.622700+0000","last_fullsized":"2023-11-24T06:14:37.622700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622284+0000","last_change":"2023-11-24T06:14:35.569460+0000","last_active":"2023-11-24T06:14:37.622284+0000","last_peered":"2023-11-24T06:14:37.622284+0000","last_clean":"2023-11-24T06:14:37.622284+0000","last_became_active":"2023-11-24T06:14:35.568985+0000","last_became_peered":"2023-11-24T06:14:35.568985+0000","last_unstale":"2023-11-24T06:14:37.622284+0000","last_undegraded":"2023-11-24T06:14:37.622284+0000","last_fullsized":"2023-11-24T06:14:37.622284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:34:04.598802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622354+0000","last_change":"2023-11-24T06:14:36.575100+0000","last_active":"2023-11-24T06:14:37.622354+0000","last_peered":"2023-11-24T06:14:37.622354+0000","last_clean":"2023-11-24T06:14:37.622354+0000","last_became_active":"2023-11-24T06:14:36.574759+0000","last_became_peered":"2023-11-24T06:14:36.574759+0000","last_unstale":"2023-11-24T06:14:37.622354+0000","last_undegraded":"2023-11-24T06:14:37.622354+0000","last_fullsized":"2023-11-24T06:14:37.622354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:27:03.566637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563333+0000","last_change":"2023-11-24T06:14:35.568629+0000","last_active":"2023-11-24T06:14:37.563333+0000","last_peered":"2023-11-24T06:14:37.563333+0000","last_clean":"2023-11-24T06:14:37.563333+0000","last_became_active":"2023-11-24T06:14:35.568332+0000","last_became_peered":"2023-11-24T06:14:35.568332+0000","last_unstale":"2023-11-24T06:14:37.563333+0000","last_undegraded":"2023-11-24T06:14:37.563333+0000","last_fullsized":"2023-11-24T06:14:37.563333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622007+0000","last_change":"2023-11-24T06:14:36.571784+0000","last_active":"2023-11-24T06:14:37.622007+0000","last_peered":"2023-11-24T06:14:37.622007+0000","last_clean":"2023-11-24T06:14:37.622007+0000","last_became_active":"2023-11-24T06:14:36.571043+0000","last_became_peered":"2023-11-24T06:14:36.571043+0000","last_unstale":"2023-11-24T06:14:37.622007+0000","last_undegraded":"2023-11-24T06:14:37.622007+0000","last_fullsized":"2023-11-24T06:14:37.622007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623113+0000","last_change":"2023-11-24T06:14:35.569525+0000","last_active":"2023-11-24T06:14:37.623113+0000","last_peered":"2023-11-24T06:14:37.623113+0000","last_clean":"2023-11-24T06:14:37.623113+0000","last_became_active":"2023-11-24T06:14:35.569230+0000","last_became_peered":"2023-11-24T06:14:35.569230+0000","last_unstale":"2023-11-24T06:14:37.623113+0000","last_undegraded":"2023-11-24T06:14:37.623113+0000","last_fullsized":"2023-11-24T06:14:37.623113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:20.718420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623076+0000","last_change":"2023-11-24T06:14:36.584974+0000","last_active":"2023-11-24T06:14:37.623076+0000","last_peered":"2023-11-24T06:14:37.623076+0000","last_clean":"2023-11-24T06:14:37.623076+0000","last_became_active":"2023-11-24T06:14:36.584195+0000","last_became_peered":"2023-11-24T06:14:36.584195+0000","last_unstale":"2023-11-24T06:14:37.623076+0000","last_undegraded":"2023-11-24T06:14:37.623076+0000","last_fullsized":"2023-11-24T06:14:37.623076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622096+0000","last_change":"2023-11-24T06:14:35.570715+0000","last_active":"2023-11-24T06:14:37.622096+0000","last_peered":"2023-11-24T06:14:37.622096+0000","last_clean":"2023-11-24T06:14:37.622096+0000","last_became_active":"2023-11-24T06:14:35.570442+0000","last_became_peered":"2023-11-24T06:14:35.570442+0000","last_unstale":"2023-11-24T06:14:37.622096+0000","last_undegraded":"2023-11-24T06:14:37.622096+0000","last_fullsized":"2023-11-24T06:14:37.622096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:46.317904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561945+0000","last_change":"2023-11-24T06:14:36.576113+0000","last_active":"2023-11-24T06:14:37.561945+0000","last_peered":"2023-11-24T06:14:37.561945+0000","last_clean":"2023-11-24T06:14:37.561945+0000","last_became_active":"2023-11-24T06:14:36.575834+0000","last_became_peered":"2023-11-24T06:14:36.575834+0000","last_unstale":"2023-11-24T06:14:37.561945+0000","last_undegraded":"2023-11-24T06:14:37.561945+0000","last_fullsized":"2023-11-24T06:14:37.561945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:34:05.605469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563439+0000","last_change":"2023-11-24T06:14:35.563772+0000","last_active":"2023-11-24T06:14:37.563439+0000","last_peered":"2023-11-24T06:14:37.563439+0000","last_clean":"2023-11-24T06:14:37.563439+0000","last_became_active":"2023-11-24T06:14:35.563487+0000","last_became_peered":"2023-11-24T06:14:35.563487+0000","last_unstale":"2023-11-24T06:14:37.563439+0000","last_undegraded":"2023-11-24T06:14:37.563439+0000","last_fullsized":"2023-11-24T06:14:37.563439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:02.261671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621800+0000","last_change":"2023-11-24T06:14:36.579630+0000","last_active":"2023-11-24T06:14:37.621800+0000","last_peered":"2023-11-24T06:14:37.621800+0000","last_clean":"2023-11-24T06:14:37.621800+0000","last_became_active":"2023-11-24T06:14:36.579371+0000","last_became_peered":"2023-11-24T06:14:36.579371+0000","last_unstale":"2023-11-24T06:14:37.621800+0000","last_undegraded":"2023-11-24T06:14:37.621800+0000","last_fullsized":"2023-11-24T06:14:37.621800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561924+0000","last_change":"2023-11-24T06:14:35.557529+0000","last_active":"2023-11-24T06:14:37.561924+0000","last_peered":"2023-11-24T06:14:37.561924+0000","last_clean":"2023-11-24T06:14:37.561924+0000","last_became_active":"2023-11-24T06:14:35.557257+0000","last_became_peered":"2023-11-24T06:14:35.557257+0000","last_unstale":"2023-11-24T06:14:37.561924+0000","last_undegraded":"2023-11-24T06:14:37.561924+0000","last_fullsized":"2023-11-24T06:14:37.561924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622614+0000","last_change":"2023-11-24T06:14:36.584625+0000","last_active":"2023-11-24T06:14:37.622614+0000","last_peered":"2023-11-24T06:14:37.622614+0000","last_clean":"2023-11-24T06:14:37.622614+0000","last_became_active":"2023-11-24T06:14:36.584332+0000","last_became_peered":"2023-11-24T06:14:36.584332+0000","last_unstale":"2023-11-24T06:14:37.622614+0000","last_undegraded":"2023-11-24T06:14:37.622614+0000","last_fullsized":"2023-11-24T06:14:37.622614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621718+0000","last_change":"2023-11-24T06:14:35.570105+0000","last_active":"2023-11-24T06:14:37.621718+0000","last_peered":"2023-11-24T06:14:37.621718+0000","last_clean":"2023-11-24T06:14:37.621718+0000","last_became_active":"2023-11-24T06:14:35.569824+0000","last_became_peered":"2023-11-24T06:14:35.569824+0000","last_unstale":"2023-11-24T06:14:37.621718+0000","last_undegraded":"2023-11-24T06:14:37.621718+0000","last_fullsized":"2023-11-24T06:14:37.621718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623073+0000","last_change":"2023-11-24T06:14:36.577724+0000","last_active":"2023-11-24T06:14:37.623073+0000","last_peered":"2023-11-24T06:14:37.623073+0000","last_clean":"2023-11-24T06:14:37.623073+0000","last_became_active":"2023-11-24T06:14:36.577462+0000","last_became_peered":"2023-11-24T06:14:36.577462+0000","last_unstale":"2023-11-24T06:14:37.623073+0000","last_undegraded":"2023-11-24T06:14:37.623073+0000","last_fullsized":"2023-11-24T06:14:37.623073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:59.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621102+0000","last_change":"2023-11-24T06:14:35.570628+0000","last_active":"2023-11-24T06:14:37.621102+0000","last_peered":"2023-11-24T06:14:37.621102+0000","last_clean":"2023-11-24T06:14:37.621102+0000","last_became_active":"2023-11-24T06:14:35.570366+0000","last_became_peered":"2023-11-24T06:14:35.570366+0000","last_unstale":"2023-11-24T06:14:37.621102+0000","last_undegraded":"2023-11-24T06:14:37.621102+0000","last_fullsized":"2023-11-24T06:14:37.621102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:10.329976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563661+0000","last_change":"2023-11-24T06:14:36.582451+0000","last_active":"2023-11-24T06:14:37.563661+0000","last_peered":"2023-11-24T06:14:37.563661+0000","last_clean":"2023-11-24T06:14:37.563661+0000","last_became_active":"2023-11-24T06:14:36.581340+0000","last_became_peered":"2023-11-24T06:14:36.581340+0000","last_unstale":"2023-11-24T06:14:37.563661+0000","last_undegraded":"2023-11-24T06:14:37.563661+0000","last_fullsized":"2023-11-24T06:14:37.563661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.345339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562769+0000","last_change":"2023-11-24T06:14:35.568366+0000","last_active":"2023-11-24T06:14:37.562769+0000","last_peered":"2023-11-24T06:14:37.562769+0000","last_clean":"2023-11-24T06:14:37.562769+0000","last_became_active":"2023-11-24T06:14:35.568104+0000","last_became_peered":"2023-11-24T06:14:35.568104+0000","last_unstale":"2023-11-24T06:14:37.562769+0000","last_undegraded":"2023-11-24T06:14:37.562769+0000","last_fullsized":"2023-11-24T06:14:37.562769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.338672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622887+0000","last_change":"2023-11-24T06:14:36.586191+0000","last_active":"2023-11-24T06:14:37.622887+0000","last_peered":"2023-11-24T06:14:37.622887+0000","last_clean":"2023-11-24T06:14:37.622887+0000","last_became_active":"2023-11-24T06:14:36.585753+0000","last_became_peered":"2023-11-24T06:14:36.585753+0000","last_unstale":"2023-11-24T06:14:37.622887+0000","last_undegraded":"2023-11-24T06:14:37.622887+0000","last_fullsized":"2023-11-24T06:14:37.622887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563724+0000","last_change":"2023-11-24T06:14:35.562657+0000","last_active":"2023-11-24T06:14:37.563724+0000","last_peered":"2023-11-24T06:14:37.563724+0000","last_clean":"2023-11-24T06:14:37.563724+0000","last_became_active":"2023-11-24T06:14:35.562346+0000","last_became_peered":"2023-11-24T06:14:35.562346+0000","last_unstale":"2023-11-24T06:14:37.563724+0000","last_undegraded":"2023-11-24T06:14:37.563724+0000","last_fullsized":"2023-11-24T06:14:37.563724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:36.039050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562069+0000","last_change":"2023-11-24T06:14:36.578644+0000","last_active":"2023-11-24T06:14:37.562069+0000","last_peered":"2023-11-24T06:14:37.562069+0000","last_clean":"2023-11-24T06:14:37.562069+0000","last_became_active":"2023-11-24T06:14:36.577881+0000","last_became_peered":"2023-11-24T06:14:36.577881+0000","last_unstale":"2023-11-24T06:14:37.562069+0000","last_undegraded":"2023-11-24T06:14:37.562069+0000","last_fullsized":"2023-11-24T06:14:37.562069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:05.329685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563587+0000","last_change":"2023-11-24T06:14:35.562394+0000","last_active":"2023-11-24T06:14:37.563587+0000","last_peered":"2023-11-24T06:14:37.563587+0000","last_clean":"2023-11-24T06:14:37.563587+0000","last_became_active":"2023-11-24T06:14:35.562045+0000","last_became_peered":"2023-11-24T06:14:35.562045+0000","last_unstale":"2023-11-24T06:14:37.563587+0000","last_undegraded":"2023-11-24T06:14:37.563587+0000","last_fullsized":"2023-11-24T06:14:37.563587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:24.867787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621363+0000","last_change":"2023-11-24T06:14:36.571139+0000","last_active":"2023-11-24T06:14:37.621363+0000","last_peered":"2023-11-24T06:14:37.621363+0000","last_clean":"2023-11-24T06:14:37.621363+0000","last_became_active":"2023-11-24T06:14:36.570824+0000","last_became_peered":"2023-11-24T06:14:36.570824+0000","last_unstale":"2023-11-24T06:14:37.621363+0000","last_undegraded":"2023-11-24T06:14:37.621363+0000","last_fullsized":"2023-11-24T06:14:37.621363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:17.208856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563587+0000","last_change":"2023-11-24T06:14:35.568542+0000","last_active":"2023-11-24T06:14:37.563587+0000","last_peered":"2023-11-24T06:14:37.563587+0000","last_clean":"2023-11-24T06:14:37.563587+0000","last_became_active":"2023-11-24T06:14:35.568237+0000","last_became_peered":"2023-11-24T06:14:35.568237+0000","last_unstale":"2023-11-24T06:14:37.563587+0000","last_undegraded":"2023-11-24T06:14:37.563587+0000","last_fullsized":"2023-11-24T06:14:37.563587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:36.981648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621312+0000","last_change":"2023-11-24T06:14:36.577229+0000","last_active":"2023-11-24T06:14:37.621312+0000","last_peered":"2023-11-24T06:14:37.621312+0000","last_clean":"2023-11-24T06:14:37.621312+0000","last_became_active":"2023-11-24T06:14:36.576944+0000","last_became_peered":"2023-11-24T06:14:36.576944+0000","last_unstale":"2023-11-24T06:14:37.621312+0000","last_undegraded":"2023-11-24T06:14:37.621312+0000","last_fullsized":"2023-11-24T06:14:37.621312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:43:42.256751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563055+0000","last_change":"2023-11-24T06:14:35.570006+0000","last_active":"2023-11-24T06:14:37.563055+0000","last_peered":"2023-11-24T06:14:37.563055+0000","last_clean":"2023-11-24T06:14:37.563055+0000","last_became_active":"2023-11-24T06:14:35.569739+0000","last_became_peered":"2023-11-24T06:14:35.569739+0000","last_unstale":"2023-11-24T06:14:37.563055+0000","last_undegraded":"2023-11-24T06:14:37.563055+0000","last_fullsized":"2023-11-24T06:14:37.563055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621418+0000","last_change":"2023-11-24T06:14:36.579982+0000","last_active":"2023-11-24T06:14:37.621418+0000","last_peered":"2023-11-24T06:14:37.621418+0000","last_clean":"2023-11-24T06:14:37.621418+0000","last_became_active":"2023-11-24T06:14:36.579698+0000","last_became_peered":"2023-11-24T06:14:36.579698+0000","last_unstale":"2023-11-24T06:14:37.621418+0000","last_undegraded":"2023-11-24T06:14:37.621418+0000","last_fullsized":"2023-11-24T06:14:37.621418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:23.289256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622512+0000","last_change":"2023-11-24T06:14:35.565436+0000","last_active":"2023-11-24T06:14:37.622512+0000","last_peered":"2023-11-24T06:14:37.622512+0000","last_clean":"2023-11-24T06:14:37.622512+0000","last_became_active":"2023-11-24T06:14:35.564546+0000","last_became_peered":"2023-11-24T06:14:35.564546+0000","last_unstale":"2023-11-24T06:14:37.622512+0000","last_undegraded":"2023-11-24T06:14:37.622512+0000","last_fullsized":"2023-11-24T06:14:37.622512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:02.261671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621520+0000","last_change":"2023-11-24T06:14:36.577703+0000","last_active":"2023-11-24T06:14:37.621520+0000","last_peered":"2023-11-24T06:14:37.621520+0000","last_clean":"2023-11-24T06:14:37.621520+0000","last_became_active":"2023-11-24T06:14:36.577375+0000","last_became_peered":"2023-11-24T06:14:36.577375+0000","last_unstale":"2023-11-24T06:14:37.621520+0000","last_undegraded":"2023-11-24T06:14:37.621520+0000","last_fullsized":"2023-11-24T06:14:37.621520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:58.217681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563293+0000","last_change":"2023-11-24T06:14:35.562045+0000","last_active":"2023-11-24T06:14:37.563293+0000","last_peered":"2023-11-24T06:14:37.563293+0000","last_clean":"2023-11-24T06:14:37.563293+0000","last_became_active":"2023-11-24T06:14:35.561438+0000","last_became_peered":"2023-11-24T06:14:35.561438+0000","last_unstale":"2023-11-24T06:14:37.563293+0000","last_undegraded":"2023-11-24T06:14:37.563293+0000","last_fullsized":"2023-11-24T06:14:37.563293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:57.211014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622270+0000","last_change":"2023-11-24T06:14:36.573270+0000","last_active":"2023-11-24T06:14:37.622270+0000","last_peered":"2023-11-24T06:14:37.622270+0000","last_clean":"2023-11-24T06:14:37.622270+0000","last_became_active":"2023-11-24T06:14:36.572951+0000","last_became_peered":"2023-11-24T06:14:36.572951+0000","last_unstale":"2023-11-24T06:14:37.622270+0000","last_undegraded":"2023-11-24T06:14:37.622270+0000","last_fullsized":"2023-11-24T06:14:37.622270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:31.953345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621770+0000","last_change":"2023-11-24T06:14:35.569387+0000","last_active":"2023-11-24T06:14:37.621770+0000","last_peered":"2023-11-24T06:14:37.621770+0000","last_clean":"2023-11-24T06:14:37.621770+0000","last_became_active":"2023-11-24T06:14:35.569055+0000","last_became_peered":"2023-11-24T06:14:35.569055+0000","last_unstale":"2023-11-24T06:14:37.621770+0000","last_undegraded":"2023-11-24T06:14:37.621770+0000","last_fullsized":"2023-11-24T06:14:37.621770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:46.317904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621519+0000","last_change":"2023-11-24T06:14:36.581900+0000","last_active":"2023-11-24T06:14:37.621519+0000","last_peered":"2023-11-24T06:14:37.621519+0000","last_clean":"2023-11-24T06:14:37.621519+0000","last_became_active":"2023-11-24T06:14:36.581599+0000","last_became_peered":"2023-11-24T06:14:36.581599+0000","last_unstale":"2023-11-24T06:14:37.621519+0000","last_undegraded":"2023-11-24T06:14:37.621519+0000","last_fullsized":"2023-11-24T06:14:37.621519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:27.288108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562719+0000","last_change":"2023-11-24T06:14:35.571906+0000","last_active":"2023-11-24T06:14:37.562719+0000","last_peered":"2023-11-24T06:14:37.562719+0000","last_clean":"2023-11-24T06:14:37.562719+0000","last_became_active":"2023-11-24T06:14:35.571645+0000","last_became_peered":"2023-11-24T06:14:35.571645+0000","last_unstale":"2023-11-24T06:14:37.562719+0000","last_undegraded":"2023-11-24T06:14:37.562719+0000","last_fullsized":"2023-11-24T06:14:37.562719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:50.028567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622735+0000","last_change":"2023-11-24T06:14:36.579107+0000","last_active":"2023-11-24T06:14:37.622735+0000","last_peered":"2023-11-24T06:14:37.622735+0000","last_clean":"2023-11-24T06:14:37.622735+0000","last_became_active":"2023-11-24T06:14:36.578818+0000","last_became_peered":"2023-11-24T06:14:36.578818+0000","last_unstale":"2023-11-24T06:14:37.622735+0000","last_undegraded":"2023-11-24T06:14:37.622735+0000","last_fullsized":"2023-11-24T06:14:37.622735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563371+0000","last_change":"2023-11-24T06:14:35.571156+0000","last_active":"2023-11-24T06:14:37.563371+0000","last_peered":"2023-11-24T06:14:37.563371+0000","last_clean":"2023-11-24T06:14:37.563371+0000","last_became_active":"2023-11-24T06:14:35.569847+0000","last_became_peered":"2023-11-24T06:14:35.569847+0000","last_unstale":"2023-11-24T06:14:37.563371+0000","last_undegraded":"2023-11-24T06:14:37.563371+0000","last_fullsized":"2023-11-24T06:14:37.563371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563040+0000","last_change":"2023-11-24T06:14:36.579084+0000","last_active":"2023-11-24T06:14:37.563040+0000","last_peered":"2023-11-24T06:14:37.563040+0000","last_clean":"2023-11-24T06:14:37.563040+0000","last_became_active":"2023-11-24T06:14:36.578808+0000","last_became_peered":"2023-11-24T06:14:36.578808+0000","last_unstale":"2023-11-24T06:14:37.563040+0000","last_undegraded":"2023-11-24T06:14:37.563040+0000","last_fullsized":"2023-11-24T06:14:37.563040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.345339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562144+0000","last_change":"2023-11-24T06:14:35.564056+0000","last_active":"2023-11-24T06:14:37.562144+0000","last_peered":"2023-11-24T06:14:37.562144+0000","last_clean":"2023-11-24T06:14:37.562144+0000","last_became_active":"2023-11-24T06:14:35.563728+0000","last_became_peered":"2023-11-24T06:14:35.563728+0000","last_unstale":"2023-11-24T06:14:37.562144+0000","last_undegraded":"2023-11-24T06:14:37.562144+0000","last_fullsized":"2023-11-24T06:14:37.562144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622705+0000","last_change":"2023-11-24T06:14:36.572005+0000","last_active":"2023-11-24T06:14:37.622705+0000","last_peered":"2023-11-24T06:14:37.622705+0000","last_clean":"2023-11-24T06:14:37.622705+0000","last_became_active":"2023-11-24T06:14:36.571591+0000","last_became_peered":"2023-11-24T06:14:36.571591+0000","last_unstale":"2023-11-24T06:14:37.622705+0000","last_undegraded":"2023-11-24T06:14:37.622705+0000","last_fullsized":"2023-11-24T06:14:37.622705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:55.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562977+0000","last_change":"2023-11-24T06:14:35.566812+0000","last_active":"2023-11-24T06:14:37.562977+0000","last_peered":"2023-11-24T06:14:37.562977+0000","last_clean":"2023-11-24T06:14:37.562977+0000","last_became_active":"2023-11-24T06:14:35.566512+0000","last_became_peered":"2023-11-24T06:14:35.566512+0000","last_unstale":"2023-11-24T06:14:37.562977+0000","last_undegraded":"2023-11-24T06:14:37.562977+0000","last_fullsized":"2023-11-24T06:14:37.562977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:10.329976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563179+0000","last_change":"2023-11-24T06:14:36.577174+0000","last_active":"2023-11-24T06:14:37.563179+0000","last_peered":"2023-11-24T06:14:37.563179+0000","last_clean":"2023-11-24T06:14:37.563179+0000","last_became_active":"2023-11-24T06:14:36.576922+0000","last_became_peered":"2023-11-24T06:14:36.576922+0000","last_unstale":"2023-11-24T06:14:37.563179+0000","last_undegraded":"2023-11-24T06:14:37.563179+0000","last_fullsized":"2023-11-24T06:14:37.563179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:45:29.958316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562010+0000","last_change":"2023-11-24T06:14:35.567598+0000","last_active":"2023-11-24T06:14:37.562010+0000","last_peered":"2023-11-24T06:14:37.562010+0000","last_clean":"2023-11-24T06:14:37.562010+0000","last_became_active":"2023-11-24T06:14:35.567308+0000","last_became_peered":"2023-11-24T06:14:35.567308+0000","last_unstale":"2023-11-24T06:14:37.562010+0000","last_undegraded":"2023-11-24T06:14:37.562010+0000","last_fullsized":"2023-11-24T06:14:37.562010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621154+0000","last_change":"2023-11-24T06:14:36.573722+0000","last_active":"2023-11-24T06:14:37.621154+0000","last_peered":"2023-11-24T06:14:37.621154+0000","last_clean":"2023-11-24T06:14:37.621154+0000","last_became_active":"2023-11-24T06:14:36.573513+0000","last_became_peered":"2023-11-24T06:14:36.573513+0000","last_unstale":"2023-11-24T06:14:37.621154+0000","last_undegraded":"2023-11-24T06:14:37.621154+0000","last_fullsized":"2023-11-24T06:14:37.621154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563373+0000","last_change":"2023-11-24T06:14:35.570379+0000","last_active":"2023-11-24T06:14:37.563373+0000","last_peered":"2023-11-24T06:14:37.563373+0000","last_clean":"2023-11-24T06:14:37.563373+0000","last_became_active":"2023-11-24T06:14:35.570088+0000","last_became_peered":"2023-11-24T06:14:35.570088+0000","last_unstale":"2023-11-24T06:14:37.563373+0000","last_undegraded":"2023-11-24T06:14:37.563373+0000","last_fullsized":"2023-11-24T06:14:37.563373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:34.799935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563125+0000","last_change":"2023-11-24T06:14:36.573948+0000","last_active":"2023-11-24T06:14:37.563125+0000","last_peered":"2023-11-24T06:14:37.563125+0000","last_clean":"2023-11-24T06:14:37.563125+0000","last_became_active":"2023-11-24T06:14:36.573655+0000","last_became_peered":"2023-11-24T06:14:36.573655+0000","last_unstale":"2023-11-24T06:14:37.563125+0000","last_undegraded":"2023-11-24T06:14:37.563125+0000","last_fullsized":"2023-11-24T06:14:37.563125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:11.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621610+0000","last_change":"2023-11-24T06:14:35.569259+0000","last_active":"2023-11-24T06:14:37.621610+0000","last_peered":"2023-11-24T06:14:37.621610+0000","last_clean":"2023-11-24T06:14:37.621610+0000","last_became_active":"2023-11-24T06:14:35.568995+0000","last_became_peered":"2023-11-24T06:14:35.568995+0000","last_unstale":"2023-11-24T06:14:37.621610+0000","last_undegraded":"2023-11-24T06:14:37.621610+0000","last_fullsized":"2023-11-24T06:14:37.621610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622671+0000","last_change":"2023-11-24T06:14:36.575376+0000","last_active":"2023-11-24T06:14:37.622671+0000","last_peered":"2023-11-24T06:14:37.622671+0000","last_clean":"2023-11-24T06:14:37.622671+0000","last_became_active":"2023-11-24T06:14:36.575108+0000","last_became_peered":"2023-11-24T06:14:36.575108+0000","last_unstale":"2023-11-24T06:14:37.622671+0000","last_undegraded":"2023-11-24T06:14:37.622671+0000","last_fullsized":"2023-11-24T06:14:37.622671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622132+0000","last_change":"2023-11-24T06:14:35.566472+0000","last_active":"2023-11-24T06:14:37.622132+0000","last_peered":"2023-11-24T06:14:37.622132+0000","last_clean":"2023-11-24T06:14:37.622132+0000","last_became_active":"2023-11-24T06:14:35.566180+0000","last_became_peered":"2023-11-24T06:14:35.566180+0000","last_unstale":"2023-11-24T06:14:37.622132+0000","last_undegraded":"2023-11-24T06:14:37.622132+0000","last_fullsized":"2023-11-24T06:14:37.622132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:26.281441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:14:36.566122+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:36.566122+0000","last_peered":"2023-11-24T06:14:36.566122+0000","last_clean":"2023-11-24T06:14:36.566122+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:36.566122+0000","last_undegraded":"2023-11-24T06:14:36.566122+0000","last_fullsized":"2023-11-24T06:14:36.566122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":730750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.44}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.441}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.433}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.624},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.505},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.378}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.252},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.318}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":1.605},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.6220000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.5780000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.496}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.379}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.442},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.626},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.505}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:40.991 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:14:41.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.144+0000 7f271351e700 1 Processor -- start 2023-11-24T06:14:41.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.144+0000 7f271351e700 1 -- start start 2023-11-24T06:14:41.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f271351e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f270c15bdd0 0x7f270c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f271351e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f271351e700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270c0b2030 con 0x7f270c0d1c70 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f271351e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270c0b2f50 con 0x7f270c15bdd0 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f271351e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0b22d0 con 0x7f270c0b3370 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:41982/0 (socket says 172.21.15.106:41982) 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 -- 172.21.15.106:0/1950739156 learned_addr learned my addr 172.21.15.106:0/1950739156 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 -- 172.21.15.106:0/1950739156 >> v2:172.21.15.176:3300/0 conn(0x7f270c15bdd0 msgr2=0x7f270c1604e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 --2- 172.21.15.106:0/1950739156 >> v2:172.21.15.176:3300/0 conn(0x7f270c15bdd0 0x7f270c1604e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 -- 172.21.15.106:0/1950739156 >> v1:172.21.15.176:6789/0 conn(0x7f270c0d1c70 legacy=0x7f270c0ce6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 -- 172.21.15.106:0/1950739156 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c0b25b0 con 0x7f270c0b3370 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.145+0000 7f2710ab9700 1 --2- 172.21.15.106:0/1950739156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098f0 tx=0x7f26fc009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e76d5373d768073 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f2703fff700 1 -- 172.21.15.106:0/1950739156 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc004230 con 0x7f270c0b3370 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f2703fff700 1 -- 172.21.15.106:0/1950739156 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc004390 con 0x7f270c0b3370 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f2703fff700 1 -- 172.21.15.106:0/1950739156 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0036a0 con 0x7f270c0b3370 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 -- 172.21.15.106:0/1950739156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 msgr2=0x7f270c0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 --2- 172.21.15.106:0/1950739156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f26fc0098f0 tx=0x7f26fc009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 -- 172.21.15.106:0/1950739156 shutdown_connections 2023-11-24T06:14:41.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 --2- 172.21.15.106:0/1950739156 >> v2:172.21.15.176:3300/0 conn(0x7f270c15bdd0 0x7f270c1604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 --2- 172.21.15.106:0/1950739156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c0b1af0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 -- 172.21.15.106:0/1950739156 >> 172.21.15.106:0/1950739156 conn(0x7f270c0731a0 msgr2=0x7f270c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 -- 172.21.15.106:0/1950739156 shutdown_connections 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.146+0000 7f271351e700 1 -- 172.21.15.106:0/1950739156 wait complete. 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.148+0000 7f271351e700 1 Processor -- start 2023-11-24T06:14:41.154 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.148+0000 7f271351e700 1 -- start start 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270c15bdd0 0x7f270c156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0c6eb0 con 0x7f270c0d1c70 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c1f67b0 con 0x7f270c15bdd0 2023-11-24T06:14:41.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f271351e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c1e64d0 con 0x7f270c0b3370 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59770/0 (socket says 172.21.15.106:59770) 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 -- 172.21.15.106:0/2122427108 learned_addr learned my addr 172.21.15.106:0/2122427108 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f27112ba700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2711abb700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270c15bdd0 0x7f270c156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 -- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 msgr2=0x7f270c1f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c1f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 -- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270c15bdd0 msgr2=0x7f270c156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270c15bdd0 0x7f270c156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 -- 172.21.15.106:0/2122427108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009550 con 0x7f270c0d1c70 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2710ab9700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009130 tx=0x7f26fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.149+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00b660 con 0x7f270c0d1c70 2023-11-24T06:14:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.150+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00b7c0 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.150+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c1572c0 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.150+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00bb30 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.150+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c1f61f0 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.151+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c067f60 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.151+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f26fc021070 con 0x7f270c0d1c70 2023-11-24T06:14:41.162 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.151+0000 7f2701ffb700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 0x7f26f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.152+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26fc08afa0 con 0x7f270c0d1c70 2023-11-24T06:14:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.152+0000 7f27112ba700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 0x7f26f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.152+0000 7f27112ba700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 0x7f26f006d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f2708008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.156+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f26fc056160 con 0x7f270c0d1c70 2023-11-24T06:14:41.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.340+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f270c0b2b70 con 0x7f26f006aed0 2023-11-24T06:14:41.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.348+0000 7f2701ffb700 1 -- 172.21.15.106:0/2122427108 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288683 (secure 0 0 0) 0x7f27080123e0 con 0x7f26f006aed0 2023-11-24T06:14:41.354 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 msgr2=0x7f26f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 0x7f26f006d390 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f2708009870 tx=0x7f2708008040 comp rx=0 tx=0).stop 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 msgr2=0x7f270c1e5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009130 tx=0x7f26fc004750 comp rx=0 tx=0).stop 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 shutdown_connections 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f26f006aed0 0x7f26f006d390 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f270c15bdd0 0x7f270c156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f270c0b3370 0x7f270c1f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 --2- 172.21.15.106:0/2122427108 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f270c0d1c70 0x7f270c1e5f90 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 >> 172.21.15.106:0/2122427108 conn(0x7f270c0731a0 msgr2=0x7f270c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 shutdown_connections 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.351+0000 7f271351e700 1 -- 172.21.15.106:0/2122427108 wait complete. 2023-11-24T06:14:41.357 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:14:41.366 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-11-24T06:14:39.699775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220192,"kb_used_data":3996,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754528,"statfs":{"total":773094113280,"available":772868636672,"internally_reserved":0,"allocated":4091904,"data_stored":2304796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.152274"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622260+0000","last_change":"2023-11-24T06:14:36.581911+0000","last_active":"2023-11-24T06:14:37.622260+0000","last_peered":"2023-11-24T06:14:37.622260+0000","last_clean":"2023-11-24T06:14:37.622260+0000","last_became_active":"2023-11-24T06:14:36.581592+0000","last_became_peered":"2023-11-24T06:14:36.581592+0000","last_unstale":"2023-11-24T06:14:37.622260+0000","last_undegraded":"2023-11-24T06:14:37.622260+0000","last_fullsized":"2023-11-24T06:14:37.622260+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:37.988314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622319+0000","last_change":"2023-11-24T06:14:36.576331+0000","last_active":"2023-11-24T06:14:37.622319+0000","last_peered":"2023-11-24T06:14:37.622319+0000","last_clean":"2023-11-24T06:14:37.622319+0000","last_became_active":"2023-11-24T06:14:36.576017+0000","last_became_peered":"2023-11-24T06:14:36.576017+0000","last_unstale":"2023-11-24T06:14:37.622319+0000","last_undegraded":"2023-11-24T06:14:37.622319+0000","last_fullsized":"2023-11-24T06:14:37.622319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:56:45.154769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622882+0000","last_change":"2023-11-24T06:14:36.584449+0000","last_active":"2023-11-24T06:14:37.622882+0000","last_peered":"2023-11-24T06:14:37.622882+0000","last_clean":"2023-11-24T06:14:37.622882+0000","last_became_active":"2023-11-24T06:14:36.584134+0000","last_became_peered":"2023-11-24T06:14:36.584134+0000","last_unstale":"2023-11-24T06:14:37.622882+0000","last_undegraded":"2023-11-24T06:14:37.622882+0000","last_fullsized":"2023-11-24T06:14:37.622882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:28.657968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561917+0000","last_change":"2023-11-24T06:14:36.578484+0000","last_active":"2023-11-24T06:14:37.561917+0000","last_peered":"2023-11-24T06:14:37.561917+0000","last_clean":"2023-11-24T06:14:37.561917+0000","last_became_active":"2023-11-24T06:14:36.578058+0000","last_became_peered":"2023-11-24T06:14:36.578058+0000","last_unstale":"2023-11-24T06:14:37.561917+0000","last_undegraded":"2023-11-24T06:14:37.561917+0000","last_fullsized":"2023-11-24T06:14:37.561917+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:06:15.696738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621310+0000","last_change":"2023-11-24T06:14:36.569434+0000","last_active":"2023-11-24T06:14:37.621310+0000","last_peered":"2023-11-24T06:14:37.621310+0000","last_clean":"2023-11-24T06:14:37.621310+0000","last_became_active":"2023-11-24T06:14:36.569184+0000","last_became_peered":"2023-11-24T06:14:36.569184+0000","last_unstale":"2023-11-24T06:14:37.621310+0000","last_undegraded":"2023-11-24T06:14:37.621310+0000","last_fullsized":"2023-11-24T06:14:37.621310+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:39:15.027925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621826+0000","last_change":"2023-11-24T06:14:36.581830+0000","last_active":"2023-11-24T06:14:37.621826+0000","last_peered":"2023-11-24T06:14:37.621826+0000","last_clean":"2023-11-24T06:14:37.621826+0000","last_became_active":"2023-11-24T06:14:36.581611+0000","last_became_peered":"2023-11-24T06:14:36.581611+0000","last_unstale":"2023-11-24T06:14:37.621826+0000","last_undegraded":"2023-11-24T06:14:37.621826+0000","last_fullsized":"2023-11-24T06:14:37.621826+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622119+0000","last_change":"2023-11-24T06:14:36.573120+0000","last_active":"2023-11-24T06:14:37.622119+0000","last_peered":"2023-11-24T06:14:37.622119+0000","last_clean":"2023-11-24T06:14:37.622119+0000","last_became_active":"2023-11-24T06:14:36.572741+0000","last_became_peered":"2023-11-24T06:14:36.572741+0000","last_unstale":"2023-11-24T06:14:37.622119+0000","last_undegraded":"2023-11-24T06:14:37.622119+0000","last_fullsized":"2023-11-24T06:14:37.622119+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:21.725087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622216+0000","last_change":"2023-11-24T06:14:36.575597+0000","last_active":"2023-11-24T06:14:37.622216+0000","last_peered":"2023-11-24T06:14:37.622216+0000","last_clean":"2023-11-24T06:14:37.622216+0000","last_became_active":"2023-11-24T06:14:36.575317+0000","last_became_peered":"2023-11-24T06:14:36.575317+0000","last_unstale":"2023-11-24T06:14:37.622216+0000","last_undegraded":"2023-11-24T06:14:37.622216+0000","last_fullsized":"2023-11-24T06:14:37.622216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563878+0000","last_change":"2023-11-24T06:14:36.574582+0000","last_active":"2023-11-24T06:14:37.563878+0000","last_peered":"2023-11-24T06:14:37.563878+0000","last_clean":"2023-11-24T06:14:37.563878+0000","last_became_active":"2023-11-24T06:14:36.573348+0000","last_became_peered":"2023-11-24T06:14:36.573348+0000","last_unstale":"2023-11-24T06:14:37.563878+0000","last_undegraded":"2023-11-24T06:14:37.563878+0000","last_fullsized":"2023-11-24T06:14:37.563878+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562613+0000","last_change":"2023-11-24T06:14:36.575451+0000","last_active":"2023-11-24T06:14:37.562613+0000","last_peered":"2023-11-24T06:14:37.562613+0000","last_clean":"2023-11-24T06:14:37.562613+0000","last_became_active":"2023-11-24T06:14:36.574687+0000","last_became_peered":"2023-11-24T06:14:36.574687+0000","last_unstale":"2023-11-24T06:14:37.562613+0000","last_undegraded":"2023-11-24T06:14:37.562613+0000","last_fullsized":"2023-11-24T06:14:37.562613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:21.725087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623005+0000","last_change":"2023-11-24T06:14:36.579431+0000","last_active":"2023-11-24T06:14:37.623005+0000","last_peered":"2023-11-24T06:14:37.623005+0000","last_clean":"2023-11-24T06:14:37.623005+0000","last_became_active":"2023-11-24T06:14:36.579120+0000","last_became_peered":"2023-11-24T06:14:36.579120+0000","last_unstale":"2023-11-24T06:14:37.623005+0000","last_undegraded":"2023-11-24T06:14:37.623005+0000","last_fullsized":"2023-11-24T06:14:37.623005+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622849+0000","last_change":"2023-11-24T06:14:36.580965+0000","last_active":"2023-11-24T06:14:37.622849+0000","last_peered":"2023-11-24T06:14:37.622849+0000","last_clean":"2023-11-24T06:14:37.622849+0000","last_became_active":"2023-11-24T06:14:36.580703+0000","last_became_peered":"2023-11-24T06:14:36.580703+0000","last_unstale":"2023-11-24T06:14:37.622849+0000","last_undegraded":"2023-11-24T06:14:37.622849+0000","last_fullsized":"2023-11-24T06:14:37.622849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621413+0000","last_change":"2023-11-24T06:14:36.573662+0000","last_active":"2023-11-24T06:14:37.621413+0000","last_peered":"2023-11-24T06:14:37.621413+0000","last_clean":"2023-11-24T06:14:37.621413+0000","last_became_active":"2023-11-24T06:14:36.573373+0000","last_became_peered":"2023-11-24T06:14:36.573373+0000","last_unstale":"2023-11-24T06:14:37.621413+0000","last_undegraded":"2023-11-24T06:14:37.621413+0000","last_fullsized":"2023-11-24T06:14:37.621413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:27:19.360985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621971+0000","last_change":"2023-11-24T06:14:36.569393+0000","last_active":"2023-11-24T06:14:37.621971+0000","last_peered":"2023-11-24T06:14:37.621971+0000","last_clean":"2023-11-24T06:14:37.621971+0000","last_became_active":"2023-11-24T06:14:36.569128+0000","last_became_peered":"2023-11-24T06:14:36.569128+0000","last_unstale":"2023-11-24T06:14:37.621971+0000","last_undegraded":"2023-11-24T06:14:37.621971+0000","last_fullsized":"2023-11-24T06:14:37.621971+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622013+0000","last_change":"2023-11-24T06:14:36.576242+0000","last_active":"2023-11-24T06:14:37.622013+0000","last_peered":"2023-11-24T06:14:37.622013+0000","last_clean":"2023-11-24T06:14:37.622013+0000","last_became_active":"2023-11-24T06:14:36.575969+0000","last_became_peered":"2023-11-24T06:14:36.575969+0000","last_unstale":"2023-11-24T06:14:37.622013+0000","last_undegraded":"2023-11-24T06:14:37.622013+0000","last_fullsized":"2023-11-24T06:14:37.622013+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622398+0000","last_change":"2023-11-24T06:14:36.579132+0000","last_active":"2023-11-24T06:14:37.622398+0000","last_peered":"2023-11-24T06:14:37.622398+0000","last_clean":"2023-11-24T06:14:37.622398+0000","last_became_active":"2023-11-24T06:14:36.578948+0000","last_became_peered":"2023-11-24T06:14:36.578948+0000","last_unstale":"2023-11-24T06:14:37.622398+0000","last_undegraded":"2023-11-24T06:14:37.622398+0000","last_fullsized":"2023-11-24T06:14:37.622398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:58.774787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622800+0000","last_change":"2023-11-24T06:14:36.574268+0000","last_active":"2023-11-24T06:14:37.622800+0000","last_peered":"2023-11-24T06:14:37.622800+0000","last_clean":"2023-11-24T06:14:37.622800+0000","last_became_active":"2023-11-24T06:14:36.572883+0000","last_became_peered":"2023-11-24T06:14:36.572883+0000","last_unstale":"2023-11-24T06:14:37.622800+0000","last_undegraded":"2023-11-24T06:14:37.622800+0000","last_fullsized":"2023-11-24T06:14:37.622800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622331+0000","last_change":"2023-11-24T06:14:36.573234+0000","last_active":"2023-11-24T06:14:37.622331+0000","last_peered":"2023-11-24T06:14:37.622331+0000","last_clean":"2023-11-24T06:14:37.622331+0000","last_became_active":"2023-11-24T06:14:36.572991+0000","last_became_peered":"2023-11-24T06:14:36.572991+0000","last_unstale":"2023-11-24T06:14:37.622331+0000","last_undegraded":"2023-11-24T06:14:37.622331+0000","last_fullsized":"2023-11-24T06:14:37.622331+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:38:11.984925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621842+0000","last_change":"2023-11-24T06:14:36.573341+0000","last_active":"2023-11-24T06:14:37.621842+0000","last_peered":"2023-11-24T06:14:37.621842+0000","last_clean":"2023-11-24T06:14:37.621842+0000","last_became_active":"2023-11-24T06:14:36.573014+0000","last_became_peered":"2023-11-24T06:14:36.573014+0000","last_unstale":"2023-11-24T06:14:37.621842+0000","last_undegraded":"2023-11-24T06:14:37.621842+0000","last_fullsized":"2023-11-24T06:14:37.621842+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:00:22.481752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621340+0000","last_change":"2023-11-24T06:14:36.581876+0000","last_active":"2023-11-24T06:14:37.621340+0000","last_peered":"2023-11-24T06:14:37.621340+0000","last_clean":"2023-11-24T06:14:37.621340+0000","last_became_active":"2023-11-24T06:14:36.581637+0000","last_became_peered":"2023-11-24T06:14:36.581637+0000","last_unstale":"2023-11-24T06:14:37.621340+0000","last_undegraded":"2023-11-24T06:14:37.621340+0000","last_fullsized":"2023-11-24T06:14:37.621340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:11:00.748272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563838+0000","last_change":"2023-11-24T06:14:36.577270+0000","last_active":"2023-11-24T06:14:37.563838+0000","last_peered":"2023-11-24T06:14:37.563838+0000","last_clean":"2023-11-24T06:14:37.563838+0000","last_became_active":"2023-11-24T06:14:36.577001+0000","last_became_peered":"2023-11-24T06:14:36.577001+0000","last_unstale":"2023-11-24T06:14:37.563838+0000","last_undegraded":"2023-11-24T06:14:37.563838+0000","last_fullsized":"2023-11-24T06:14:37.563838+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:45:29.958316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563372+0000","last_change":"2023-11-24T06:14:36.573759+0000","last_active":"2023-11-24T06:14:37.563372+0000","last_peered":"2023-11-24T06:14:37.563372+0000","last_clean":"2023-11-24T06:14:37.563372+0000","last_became_active":"2023-11-24T06:14:36.573495+0000","last_became_peered":"2023-11-24T06:14:36.573495+0000","last_unstale":"2023-11-24T06:14:37.563372+0000","last_undegraded":"2023-11-24T06:14:37.563372+0000","last_fullsized":"2023-11-24T06:14:37.563372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:42.895254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562974+0000","last_change":"2023-11-24T06:14:36.578992+0000","last_active":"2023-11-24T06:14:37.562974+0000","last_peered":"2023-11-24T06:14:37.562974+0000","last_clean":"2023-11-24T06:14:37.562974+0000","last_became_active":"2023-11-24T06:14:36.578697+0000","last_became_peered":"2023-11-24T06:14:36.578697+0000","last_unstale":"2023-11-24T06:14:37.562974+0000","last_undegraded":"2023-11-24T06:14:37.562974+0000","last_fullsized":"2023-11-24T06:14:37.562974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:51.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622650+0000","last_change":"2023-11-24T06:14:36.576646+0000","last_active":"2023-11-24T06:14:37.622650+0000","last_peered":"2023-11-24T06:14:37.622650+0000","last_clean":"2023-11-24T06:14:37.622650+0000","last_became_active":"2023-11-24T06:14:36.576386+0000","last_became_peered":"2023-11-24T06:14:36.576386+0000","last_unstale":"2023-11-24T06:14:37.622650+0000","last_undegraded":"2023-11-24T06:14:37.622650+0000","last_fullsized":"2023-11-24T06:14:37.622650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562661+0000","last_change":"2023-11-24T06:14:36.576230+0000","last_active":"2023-11-24T06:14:37.562661+0000","last_peered":"2023-11-24T06:14:37.562661+0000","last_clean":"2023-11-24T06:14:37.562661+0000","last_became_active":"2023-11-24T06:14:36.575971+0000","last_became_peered":"2023-11-24T06:14:36.575971+0000","last_unstale":"2023-11-24T06:14:37.562661+0000","last_undegraded":"2023-11-24T06:14:37.562661+0000","last_fullsized":"2023-11-24T06:14:37.562661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:49:49.174728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622397+0000","last_change":"2023-11-24T06:14:36.570228+0000","last_active":"2023-11-24T06:14:37.622397+0000","last_peered":"2023-11-24T06:14:37.622397+0000","last_clean":"2023-11-24T06:14:37.622397+0000","last_became_active":"2023-11-24T06:14:36.569907+0000","last_became_peered":"2023-11-24T06:14:36.569907+0000","last_unstale":"2023-11-24T06:14:37.622397+0000","last_undegraded":"2023-11-24T06:14:37.622397+0000","last_fullsized":"2023-11-24T06:14:37.622397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:26:12.878443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562457+0000","last_change":"2023-11-24T06:14:36.578188+0000","last_active":"2023-11-24T06:14:37.562457+0000","last_peered":"2023-11-24T06:14:37.562457+0000","last_clean":"2023-11-24T06:14:37.562457+0000","last_became_active":"2023-11-24T06:14:36.577908+0000","last_became_peered":"2023-11-24T06:14:36.577908+0000","last_unstale":"2023-11-24T06:14:37.562457+0000","last_undegraded":"2023-11-24T06:14:37.562457+0000","last_fullsized":"2023-11-24T06:14:37.562457+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:02:30.726946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622400+0000","last_change":"2023-11-24T06:14:36.579751+0000","last_active":"2023-11-24T06:14:37.622400+0000","last_peered":"2023-11-24T06:14:37.622400+0000","last_clean":"2023-11-24T06:14:37.622400+0000","last_became_active":"2023-11-24T06:14:36.579460+0000","last_became_peered":"2023-11-24T06:14:36.579460+0000","last_unstale":"2023-11-24T06:14:37.622400+0000","last_undegraded":"2023-11-24T06:14:37.622400+0000","last_fullsized":"2023-11-24T06:14:37.622400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:38:58.774787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563219+0000","last_change":"2023-11-24T06:14:36.572754+0000","last_active":"2023-11-24T06:14:37.563219+0000","last_peered":"2023-11-24T06:14:37.563219+0000","last_clean":"2023-11-24T06:14:37.563219+0000","last_became_active":"2023-11-24T06:14:36.572469+0000","last_became_peered":"2023-11-24T06:14:36.572469+0000","last_unstale":"2023-11-24T06:14:37.563219+0000","last_undegraded":"2023-11-24T06:14:37.563219+0000","last_fullsized":"2023-11-24T06:14:37.563219+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:59.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622424+0000","last_change":"2023-11-24T06:14:36.574036+0000","last_active":"2023-11-24T06:14:37.622424+0000","last_peered":"2023-11-24T06:14:37.622424+0000","last_clean":"2023-11-24T06:14:37.622424+0000","last_became_active":"2023-11-24T06:14:36.573724+0000","last_became_peered":"2023-11-24T06:14:36.573724+0000","last_unstale":"2023-11-24T06:14:37.622424+0000","last_undegraded":"2023-11-24T06:14:37.622424+0000","last_fullsized":"2023-11-24T06:14:37.622424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:14:28.657968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623112+0000","last_change":"2023-11-24T06:14:36.569379+0000","last_active":"2023-11-24T06:14:37.623112+0000","last_peered":"2023-11-24T06:14:37.623112+0000","last_clean":"2023-11-24T06:14:37.623112+0000","last_became_active":"2023-11-24T06:14:36.568881+0000","last_became_peered":"2023-11-24T06:14:36.568881+0000","last_unstale":"2023-11-24T06:14:37.623112+0000","last_undegraded":"2023-11-24T06:14:37.623112+0000","last_fullsized":"2023-11-24T06:14:37.623112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:42.895254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622862+0000","last_change":"2023-11-24T06:14:36.585094+0000","last_active":"2023-11-24T06:14:37.622862+0000","last_peered":"2023-11-24T06:14:37.622862+0000","last_clean":"2023-11-24T06:14:37.622862+0000","last_became_active":"2023-11-24T06:14:36.584811+0000","last_became_peered":"2023-11-24T06:14:36.584811+0000","last_unstale":"2023-11-24T06:14:37.622862+0000","last_undegraded":"2023-11-24T06:14:37.622862+0000","last_fullsized":"2023-11-24T06:14:37.622862+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563246+0000","last_change":"2023-11-24T06:14:36.577475+0000","last_active":"2023-11-24T06:14:37.563246+0000","last_peered":"2023-11-24T06:14:37.563246+0000","last_clean":"2023-11-24T06:14:37.563246+0000","last_became_active":"2023-11-24T06:14:36.577190+0000","last_became_peered":"2023-11-24T06:14:36.577190+0000","last_unstale":"2023-11-24T06:14:37.563246+0000","last_undegraded":"2023-11-24T06:14:37.563246+0000","last_fullsized":"2023-11-24T06:14:37.563246+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622519+0000","last_change":"2023-11-24T06:14:35.566892+0000","last_active":"2023-11-24T06:14:37.622519+0000","last_peered":"2023-11-24T06:14:37.622519+0000","last_clean":"2023-11-24T06:14:37.622519+0000","last_became_active":"2023-11-24T06:14:35.566644+0000","last_became_peered":"2023-11-24T06:14:35.566644+0000","last_unstale":"2023-11-24T06:14:37.622519+0000","last_undegraded":"2023-11-24T06:14:37.622519+0000","last_fullsized":"2023-11-24T06:14:37.622519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:36.039050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622420+0000","last_change":"2023-11-24T06:14:36.571140+0000","last_active":"2023-11-24T06:14:37.622420+0000","last_peered":"2023-11-24T06:14:37.622420+0000","last_clean":"2023-11-24T06:14:37.622420+0000","last_became_active":"2023-11-24T06:14:36.570840+0000","last_became_peered":"2023-11-24T06:14:36.570840+0000","last_unstale":"2023-11-24T06:14:37.622420+0000","last_undegraded":"2023-11-24T06:14:37.622420+0000","last_fullsized":"2023-11-24T06:14:37.622420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:11.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563293+0000","last_change":"2023-11-24T06:14:35.569574+0000","last_active":"2023-11-24T06:14:37.563293+0000","last_peered":"2023-11-24T06:14:37.563293+0000","last_clean":"2023-11-24T06:14:37.563293+0000","last_became_active":"2023-11-24T06:14:35.569320+0000","last_became_peered":"2023-11-24T06:14:35.569320+0000","last_unstale":"2023-11-24T06:14:37.563293+0000","last_undegraded":"2023-11-24T06:14:37.563293+0000","last_fullsized":"2023-11-24T06:14:37.563293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:36.981648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563469+0000","last_change":"2023-11-24T06:14:36.573148+0000","last_active":"2023-11-24T06:14:37.563469+0000","last_peered":"2023-11-24T06:14:37.563469+0000","last_clean":"2023-11-24T06:14:37.563469+0000","last_became_active":"2023-11-24T06:14:36.571850+0000","last_became_peered":"2023-11-24T06:14:36.571850+0000","last_unstale":"2023-11-24T06:14:37.563469+0000","last_undegraded":"2023-11-24T06:14:37.563469+0000","last_fullsized":"2023-11-24T06:14:37.563469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:51.035234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622192+0000","last_change":"2023-11-24T06:14:35.567271+0000","last_active":"2023-11-24T06:14:37.622192+0000","last_peered":"2023-11-24T06:14:37.622192+0000","last_clean":"2023-11-24T06:14:37.622192+0000","last_became_active":"2023-11-24T06:14:35.566902+0000","last_became_peered":"2023-11-24T06:14:35.566902+0000","last_unstale":"2023-11-24T06:14:37.622192+0000","last_undegraded":"2023-11-24T06:14:37.622192+0000","last_fullsized":"2023-11-24T06:14:37.622192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:26.171572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562435+0000","last_change":"2023-11-24T06:14:36.584365+0000","last_active":"2023-11-24T06:14:37.562435+0000","last_peered":"2023-11-24T06:14:37.562435+0000","last_clean":"2023-11-24T06:14:37.562435+0000","last_became_active":"2023-11-24T06:14:36.584130+0000","last_became_peered":"2023-11-24T06:14:36.584130+0000","last_unstale":"2023-11-24T06:14:37.562435+0000","last_undegraded":"2023-11-24T06:14:37.562435+0000","last_fullsized":"2023-11-24T06:14:37.562435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:49:27.178239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621431+0000","last_change":"2023-11-24T06:14:35.564827+0000","last_active":"2023-11-24T06:14:37.621431+0000","last_peered":"2023-11-24T06:14:37.621431+0000","last_clean":"2023-11-24T06:14:37.621431+0000","last_became_active":"2023-11-24T06:14:35.564586+0000","last_became_peered":"2023-11-24T06:14:35.564586+0000","last_unstale":"2023-11-24T06:14:37.621431+0000","last_undegraded":"2023-11-24T06:14:37.621431+0000","last_fullsized":"2023-11-24T06:14:37.621431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:30:35.764396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622708+0000","last_change":"2023-11-24T06:14:36.584649+0000","last_active":"2023-11-24T06:14:37.622708+0000","last_peered":"2023-11-24T06:14:37.622708+0000","last_clean":"2023-11-24T06:14:37.622708+0000","last_became_active":"2023-11-24T06:14:36.584368+0000","last_became_peered":"2023-11-24T06:14:36.584368+0000","last_unstale":"2023-11-24T06:14:37.622708+0000","last_undegraded":"2023-11-24T06:14:37.622708+0000","last_fullsized":"2023-11-24T06:14:37.622708+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563337+0000","last_change":"2023-11-24T06:14:35.567610+0000","last_active":"2023-11-24T06:14:37.563337+0000","last_peered":"2023-11-24T06:14:37.563337+0000","last_clean":"2023-11-24T06:14:37.563337+0000","last_became_active":"2023-11-24T06:14:35.567334+0000","last_became_peered":"2023-11-24T06:14:35.567334+0000","last_unstale":"2023-11-24T06:14:37.563337+0000","last_undegraded":"2023-11-24T06:14:37.563337+0000","last_fullsized":"2023-11-24T06:14:37.563337+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:37:35.956469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622104+0000","last_change":"2023-11-24T06:14:36.580145+0000","last_active":"2023-11-24T06:14:37.622104+0000","last_peered":"2023-11-24T06:14:37.622104+0000","last_clean":"2023-11-24T06:14:37.622104+0000","last_became_active":"2023-11-24T06:14:36.579505+0000","last_became_peered":"2023-11-24T06:14:36.579505+0000","last_unstale":"2023-11-24T06:14:37.622104+0000","last_undegraded":"2023-11-24T06:14:37.622104+0000","last_fullsized":"2023-11-24T06:14:37.622104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:31.953345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563386+0000","last_change":"2023-11-24T06:14:35.568375+0000","last_active":"2023-11-24T06:14:37.563386+0000","last_peered":"2023-11-24T06:14:37.563386+0000","last_clean":"2023-11-24T06:14:37.563386+0000","last_became_active":"2023-11-24T06:14:35.568118+0000","last_became_peered":"2023-11-24T06:14:35.568118+0000","last_unstale":"2023-11-24T06:14:37.563386+0000","last_undegraded":"2023-11-24T06:14:37.563386+0000","last_fullsized":"2023-11-24T06:14:37.563386+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:10:59.741605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563461+0000","last_change":"2023-11-24T06:14:36.572248+0000","last_active":"2023-11-24T06:14:37.563461+0000","last_peered":"2023-11-24T06:14:37.563461+0000","last_clean":"2023-11-24T06:14:37.563461+0000","last_became_active":"2023-11-24T06:14:36.571957+0000","last_became_peered":"2023-11-24T06:14:36.571957+0000","last_unstale":"2023-11-24T06:14:37.563461+0000","last_undegraded":"2023-11-24T06:14:37.563461+0000","last_fullsized":"2023-11-24T06:14:37.563461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:55.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621657+0000","last_change":"2023-11-24T06:14:35.567224+0000","last_active":"2023-11-24T06:14:37.621657+0000","last_peered":"2023-11-24T06:14:37.621657+0000","last_clean":"2023-11-24T06:14:37.621657+0000","last_became_active":"2023-11-24T06:14:35.566960+0000","last_became_peered":"2023-11-24T06:14:35.566960+0000","last_unstale":"2023-11-24T06:14:37.621657+0000","last_undegraded":"2023-11-24T06:14:37.621657+0000","last_fullsized":"2023-11-24T06:14:37.621657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561773+0000","last_change":"2023-11-24T06:14:36.584514+0000","last_active":"2023-11-24T06:14:37.561773+0000","last_peered":"2023-11-24T06:14:37.561773+0000","last_clean":"2023-11-24T06:14:37.561773+0000","last_became_active":"2023-11-24T06:14:36.584284+0000","last_became_peered":"2023-11-24T06:14:36.584284+0000","last_unstale":"2023-11-24T06:14:37.561773+0000","last_undegraded":"2023-11-24T06:14:37.561773+0000","last_fullsized":"2023-11-24T06:14:37.561773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:47.324571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563413+0000","last_change":"2023-11-24T06:14:35.560626+0000","last_active":"2023-11-24T06:14:37.563413+0000","last_peered":"2023-11-24T06:14:37.563413+0000","last_clean":"2023-11-24T06:14:37.563413+0000","last_became_active":"2023-11-24T06:14:35.560354+0000","last_became_peered":"2023-11-24T06:14:35.560354+0000","last_unstale":"2023-11-24T06:14:37.563413+0000","last_undegraded":"2023-11-24T06:14:37.563413+0000","last_fullsized":"2023-11-24T06:14:37.563413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:26.281441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622700+0000","last_change":"2023-11-24T06:14:36.580739+0000","last_active":"2023-11-24T06:14:37.622700+0000","last_peered":"2023-11-24T06:14:37.622700+0000","last_clean":"2023-11-24T06:14:37.622700+0000","last_became_active":"2023-11-24T06:14:36.580484+0000","last_became_peered":"2023-11-24T06:14:36.580484+0000","last_unstale":"2023-11-24T06:14:37.622700+0000","last_undegraded":"2023-11-24T06:14:37.622700+0000","last_fullsized":"2023-11-24T06:14:37.622700+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:30:10.322160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622284+0000","last_change":"2023-11-24T06:14:35.569460+0000","last_active":"2023-11-24T06:14:37.622284+0000","last_peered":"2023-11-24T06:14:37.622284+0000","last_clean":"2023-11-24T06:14:37.622284+0000","last_became_active":"2023-11-24T06:14:35.568985+0000","last_became_peered":"2023-11-24T06:14:35.568985+0000","last_unstale":"2023-11-24T06:14:37.622284+0000","last_undegraded":"2023-11-24T06:14:37.622284+0000","last_fullsized":"2023-11-24T06:14:37.622284+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:34:04.598802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622354+0000","last_change":"2023-11-24T06:14:36.575100+0000","last_active":"2023-11-24T06:14:37.622354+0000","last_peered":"2023-11-24T06:14:37.622354+0000","last_clean":"2023-11-24T06:14:37.622354+0000","last_became_active":"2023-11-24T06:14:36.574759+0000","last_became_peered":"2023-11-24T06:14:36.574759+0000","last_unstale":"2023-11-24T06:14:37.622354+0000","last_undegraded":"2023-11-24T06:14:37.622354+0000","last_fullsized":"2023-11-24T06:14:37.622354+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T13:27:03.566637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563333+0000","last_change":"2023-11-24T06:14:35.568629+0000","last_active":"2023-11-24T06:14:37.563333+0000","last_peered":"2023-11-24T06:14:37.563333+0000","last_clean":"2023-11-24T06:14:37.563333+0000","last_became_active":"2023-11-24T06:14:35.568332+0000","last_became_peered":"2023-11-24T06:14:35.568332+0000","last_unstale":"2023-11-24T06:14:37.563333+0000","last_undegraded":"2023-11-24T06:14:37.563333+0000","last_fullsized":"2023-11-24T06:14:37.563333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622007+0000","last_change":"2023-11-24T06:14:36.571784+0000","last_active":"2023-11-24T06:14:37.622007+0000","last_peered":"2023-11-24T06:14:37.622007+0000","last_clean":"2023-11-24T06:14:37.622007+0000","last_became_active":"2023-11-24T06:14:36.571043+0000","last_became_peered":"2023-11-24T06:14:36.571043+0000","last_unstale":"2023-11-24T06:14:37.622007+0000","last_undegraded":"2023-11-24T06:14:37.622007+0000","last_fullsized":"2023-11-24T06:14:37.622007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623113+0000","last_change":"2023-11-24T06:14:35.569525+0000","last_active":"2023-11-24T06:14:37.623113+0000","last_peered":"2023-11-24T06:14:37.623113+0000","last_clean":"2023-11-24T06:14:37.623113+0000","last_became_active":"2023-11-24T06:14:35.569230+0000","last_became_peered":"2023-11-24T06:14:35.569230+0000","last_unstale":"2023-11-24T06:14:37.623113+0000","last_undegraded":"2023-11-24T06:14:37.623113+0000","last_fullsized":"2023-11-24T06:14:37.623113+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:48:20.718420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623076+0000","last_change":"2023-11-24T06:14:36.584974+0000","last_active":"2023-11-24T06:14:37.623076+0000","last_peered":"2023-11-24T06:14:37.623076+0000","last_clean":"2023-11-24T06:14:37.623076+0000","last_became_active":"2023-11-24T06:14:36.584195+0000","last_became_peered":"2023-11-24T06:14:36.584195+0000","last_unstale":"2023-11-24T06:14:37.623076+0000","last_undegraded":"2023-11-24T06:14:37.623076+0000","last_fullsized":"2023-11-24T06:14:37.623076+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:10:02.065604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622096+0000","last_change":"2023-11-24T06:14:35.570715+0000","last_active":"2023-11-24T06:14:37.622096+0000","last_peered":"2023-11-24T06:14:37.622096+0000","last_clean":"2023-11-24T06:14:37.622096+0000","last_became_active":"2023-11-24T06:14:35.570442+0000","last_became_peered":"2023-11-24T06:14:35.570442+0000","last_unstale":"2023-11-24T06:14:37.622096+0000","last_undegraded":"2023-11-24T06:14:37.622096+0000","last_fullsized":"2023-11-24T06:14:37.622096+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:46.317904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561945+0000","last_change":"2023-11-24T06:14:36.576113+0000","last_active":"2023-11-24T06:14:37.561945+0000","last_peered":"2023-11-24T06:14:37.561945+0000","last_clean":"2023-11-24T06:14:37.561945+0000","last_became_active":"2023-11-24T06:14:36.575834+0000","last_became_peered":"2023-11-24T06:14:36.575834+0000","last_unstale":"2023-11-24T06:14:37.561945+0000","last_undegraded":"2023-11-24T06:14:37.561945+0000","last_fullsized":"2023-11-24T06:14:37.561945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:34:05.605469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563439+0000","last_change":"2023-11-24T06:14:35.563772+0000","last_active":"2023-11-24T06:14:37.563439+0000","last_peered":"2023-11-24T06:14:37.563439+0000","last_clean":"2023-11-24T06:14:37.563439+0000","last_became_active":"2023-11-24T06:14:35.563487+0000","last_became_peered":"2023-11-24T06:14:35.563487+0000","last_unstale":"2023-11-24T06:14:37.563439+0000","last_undegraded":"2023-11-24T06:14:37.563439+0000","last_fullsized":"2023-11-24T06:14:37.563439+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:02.261671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621800+0000","last_change":"2023-11-24T06:14:36.579630+0000","last_active":"2023-11-24T06:14:37.621800+0000","last_peered":"2023-11-24T06:14:37.621800+0000","last_clean":"2023-11-24T06:14:37.621800+0000","last_became_active":"2023-11-24T06:14:36.579371+0000","last_became_peered":"2023-11-24T06:14:36.579371+0000","last_unstale":"2023-11-24T06:14:37.621800+0000","last_undegraded":"2023-11-24T06:14:37.621800+0000","last_fullsized":"2023-11-24T06:14:37.621800+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.561924+0000","last_change":"2023-11-24T06:14:35.557529+0000","last_active":"2023-11-24T06:14:37.561924+0000","last_peered":"2023-11-24T06:14:37.561924+0000","last_clean":"2023-11-24T06:14:37.561924+0000","last_became_active":"2023-11-24T06:14:35.557257+0000","last_became_peered":"2023-11-24T06:14:35.557257+0000","last_unstale":"2023-11-24T06:14:37.561924+0000","last_undegraded":"2023-11-24T06:14:37.561924+0000","last_fullsized":"2023-11-24T06:14:37.561924+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622614+0000","last_change":"2023-11-24T06:14:36.584625+0000","last_active":"2023-11-24T06:14:37.622614+0000","last_peered":"2023-11-24T06:14:37.622614+0000","last_clean":"2023-11-24T06:14:37.622614+0000","last_became_active":"2023-11-24T06:14:36.584332+0000","last_became_peered":"2023-11-24T06:14:36.584332+0000","last_unstale":"2023-11-24T06:14:37.622614+0000","last_undegraded":"2023-11-24T06:14:37.622614+0000","last_fullsized":"2023-11-24T06:14:37.622614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621718+0000","last_change":"2023-11-24T06:14:35.570105+0000","last_active":"2023-11-24T06:14:37.621718+0000","last_peered":"2023-11-24T06:14:37.621718+0000","last_clean":"2023-11-24T06:14:37.621718+0000","last_became_active":"2023-11-24T06:14:35.569824+0000","last_became_peered":"2023-11-24T06:14:35.569824+0000","last_unstale":"2023-11-24T06:14:37.621718+0000","last_undegraded":"2023-11-24T06:14:37.621718+0000","last_fullsized":"2023-11-24T06:14:37.621718+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:54.086401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.623073+0000","last_change":"2023-11-24T06:14:36.577724+0000","last_active":"2023-11-24T06:14:37.623073+0000","last_peered":"2023-11-24T06:14:37.623073+0000","last_clean":"2023-11-24T06:14:37.623073+0000","last_became_active":"2023-11-24T06:14:36.577462+0000","last_became_peered":"2023-11-24T06:14:36.577462+0000","last_unstale":"2023-11-24T06:14:37.623073+0000","last_undegraded":"2023-11-24T06:14:37.623073+0000","last_fullsized":"2023-11-24T06:14:37.623073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:59.816803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":20,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621102+0000","last_change":"2023-11-24T06:14:35.570628+0000","last_active":"2023-11-24T06:14:37.621102+0000","last_peered":"2023-11-24T06:14:37.621102+0000","last_clean":"2023-11-24T06:14:37.621102+0000","last_became_active":"2023-11-24T06:14:35.570366+0000","last_became_peered":"2023-11-24T06:14:35.570366+0000","last_unstale":"2023-11-24T06:14:37.621102+0000","last_undegraded":"2023-11-24T06:14:37.621102+0000","last_fullsized":"2023-11-24T06:14:37.621102+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:10.329976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563661+0000","last_change":"2023-11-24T06:14:36.582451+0000","last_active":"2023-11-24T06:14:37.563661+0000","last_peered":"2023-11-24T06:14:37.563661+0000","last_clean":"2023-11-24T06:14:37.563661+0000","last_became_active":"2023-11-24T06:14:36.581340+0000","last_became_peered":"2023-11-24T06:14:36.581340+0000","last_unstale":"2023-11-24T06:14:37.563661+0000","last_undegraded":"2023-11-24T06:14:37.563661+0000","last_fullsized":"2023-11-24T06:14:37.563661+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.345339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562769+0000","last_change":"2023-11-24T06:14:35.568366+0000","last_active":"2023-11-24T06:14:37.562769+0000","last_peered":"2023-11-24T06:14:37.562769+0000","last_clean":"2023-11-24T06:14:37.562769+0000","last_became_active":"2023-11-24T06:14:35.568104+0000","last_became_peered":"2023-11-24T06:14:35.568104+0000","last_unstale":"2023-11-24T06:14:37.562769+0000","last_undegraded":"2023-11-24T06:14:37.562769+0000","last_fullsized":"2023-11-24T06:14:37.562769+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:43.338672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622887+0000","last_change":"2023-11-24T06:14:36.586191+0000","last_active":"2023-11-24T06:14:37.622887+0000","last_peered":"2023-11-24T06:14:37.622887+0000","last_clean":"2023-11-24T06:14:37.622887+0000","last_became_active":"2023-11-24T06:14:36.585753+0000","last_became_peered":"2023-11-24T06:14:36.585753+0000","last_unstale":"2023-11-24T06:14:37.622887+0000","last_undegraded":"2023-11-24T06:14:37.622887+0000","last_fullsized":"2023-11-24T06:14:37.622887+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:22:11.722967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563724+0000","last_change":"2023-11-24T06:14:35.562657+0000","last_active":"2023-11-24T06:14:37.563724+0000","last_peered":"2023-11-24T06:14:37.563724+0000","last_clean":"2023-11-24T06:14:37.563724+0000","last_became_active":"2023-11-24T06:14:35.562346+0000","last_became_peered":"2023-11-24T06:14:35.562346+0000","last_unstale":"2023-11-24T06:14:37.563724+0000","last_undegraded":"2023-11-24T06:14:37.563724+0000","last_fullsized":"2023-11-24T06:14:37.563724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:31:36.039050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562069+0000","last_change":"2023-11-24T06:14:36.578644+0000","last_active":"2023-11-24T06:14:37.562069+0000","last_peered":"2023-11-24T06:14:37.562069+0000","last_clean":"2023-11-24T06:14:37.562069+0000","last_became_active":"2023-11-24T06:14:36.577881+0000","last_became_peered":"2023-11-24T06:14:36.577881+0000","last_unstale":"2023-11-24T06:14:37.562069+0000","last_undegraded":"2023-11-24T06:14:37.562069+0000","last_fullsized":"2023-11-24T06:14:37.562069+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:51:05.329685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563587+0000","last_change":"2023-11-24T06:14:35.562394+0000","last_active":"2023-11-24T06:14:37.563587+0000","last_peered":"2023-11-24T06:14:37.563587+0000","last_clean":"2023-11-24T06:14:37.563587+0000","last_became_active":"2023-11-24T06:14:35.562045+0000","last_became_peered":"2023-11-24T06:14:35.562045+0000","last_unstale":"2023-11-24T06:14:37.563587+0000","last_undegraded":"2023-11-24T06:14:37.563587+0000","last_fullsized":"2023-11-24T06:14:37.563587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:41:24.867787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621363+0000","last_change":"2023-11-24T06:14:36.571139+0000","last_active":"2023-11-24T06:14:37.621363+0000","last_peered":"2023-11-24T06:14:37.621363+0000","last_clean":"2023-11-24T06:14:37.621363+0000","last_became_active":"2023-11-24T06:14:36.570824+0000","last_became_peered":"2023-11-24T06:14:36.570824+0000","last_unstale":"2023-11-24T06:14:37.621363+0000","last_undegraded":"2023-11-24T06:14:37.621363+0000","last_fullsized":"2023-11-24T06:14:37.621363+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:17.208856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563587+0000","last_change":"2023-11-24T06:14:35.568542+0000","last_active":"2023-11-24T06:14:37.563587+0000","last_peered":"2023-11-24T06:14:37.563587+0000","last_clean":"2023-11-24T06:14:37.563587+0000","last_became_active":"2023-11-24T06:14:35.568237+0000","last_became_peered":"2023-11-24T06:14:35.568237+0000","last_unstale":"2023-11-24T06:14:37.563587+0000","last_undegraded":"2023-11-24T06:14:37.563587+0000","last_fullsized":"2023-11-24T06:14:37.563587+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:38:36.981648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621312+0000","last_change":"2023-11-24T06:14:36.577229+0000","last_active":"2023-11-24T06:14:37.621312+0000","last_peered":"2023-11-24T06:14:37.621312+0000","last_clean":"2023-11-24T06:14:37.621312+0000","last_became_active":"2023-11-24T06:14:36.576944+0000","last_became_peered":"2023-11-24T06:14:36.576944+0000","last_unstale":"2023-11-24T06:14:37.621312+0000","last_undegraded":"2023-11-24T06:14:37.621312+0000","last_fullsized":"2023-11-24T06:14:37.621312+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T15:43:42.256751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563055+0000","last_change":"2023-11-24T06:14:35.570006+0000","last_active":"2023-11-24T06:14:37.563055+0000","last_peered":"2023-11-24T06:14:37.563055+0000","last_clean":"2023-11-24T06:14:37.563055+0000","last_became_active":"2023-11-24T06:14:35.569739+0000","last_became_peered":"2023-11-24T06:14:35.569739+0000","last_unstale":"2023-11-24T06:14:37.563055+0000","last_undegraded":"2023-11-24T06:14:37.563055+0000","last_fullsized":"2023-11-24T06:14:37.563055+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621418+0000","last_change":"2023-11-24T06:14:36.579982+0000","last_active":"2023-11-24T06:14:37.621418+0000","last_peered":"2023-11-24T06:14:37.621418+0000","last_clean":"2023-11-24T06:14:37.621418+0000","last_became_active":"2023-11-24T06:14:36.579698+0000","last_became_peered":"2023-11-24T06:14:36.579698+0000","last_unstale":"2023-11-24T06:14:37.621418+0000","last_undegraded":"2023-11-24T06:14:37.621418+0000","last_fullsized":"2023-11-24T06:14:37.621418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:01:23.289256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622512+0000","last_change":"2023-11-24T06:14:35.565436+0000","last_active":"2023-11-24T06:14:37.622512+0000","last_peered":"2023-11-24T06:14:37.622512+0000","last_clean":"2023-11-24T06:14:37.622512+0000","last_became_active":"2023-11-24T06:14:35.564546+0000","last_became_peered":"2023-11-24T06:14:35.564546+0000","last_unstale":"2023-11-24T06:14:37.622512+0000","last_undegraded":"2023-11-24T06:14:37.622512+0000","last_fullsized":"2023-11-24T06:14:37.622512+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:44:02.261671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621520+0000","last_change":"2023-11-24T06:14:36.577703+0000","last_active":"2023-11-24T06:14:37.621520+0000","last_peered":"2023-11-24T06:14:37.621520+0000","last_clean":"2023-11-24T06:14:37.621520+0000","last_became_active":"2023-11-24T06:14:36.577375+0000","last_became_peered":"2023-11-24T06:14:36.577375+0000","last_unstale":"2023-11-24T06:14:37.621520+0000","last_undegraded":"2023-11-24T06:14:37.621520+0000","last_fullsized":"2023-11-24T06:14:37.621520+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:58.217681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563293+0000","last_change":"2023-11-24T06:14:35.562045+0000","last_active":"2023-11-24T06:14:37.563293+0000","last_peered":"2023-11-24T06:14:37.563293+0000","last_clean":"2023-11-24T06:14:37.563293+0000","last_became_active":"2023-11-24T06:14:35.561438+0000","last_became_peered":"2023-11-24T06:14:35.561438+0000","last_unstale":"2023-11-24T06:14:37.563293+0000","last_undegraded":"2023-11-24T06:14:37.563293+0000","last_fullsized":"2023-11-24T06:14:37.563293+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:10:57.211014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622270+0000","last_change":"2023-11-24T06:14:36.573270+0000","last_active":"2023-11-24T06:14:37.622270+0000","last_peered":"2023-11-24T06:14:37.622270+0000","last_clean":"2023-11-24T06:14:37.622270+0000","last_became_active":"2023-11-24T06:14:36.572951+0000","last_became_peered":"2023-11-24T06:14:36.572951+0000","last_unstale":"2023-11-24T06:14:37.622270+0000","last_undegraded":"2023-11-24T06:14:37.622270+0000","last_fullsized":"2023-11-24T06:14:37.622270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:18:31.953345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621770+0000","last_change":"2023-11-24T06:14:35.569387+0000","last_active":"2023-11-24T06:14:37.621770+0000","last_peered":"2023-11-24T06:14:37.621770+0000","last_clean":"2023-11-24T06:14:37.621770+0000","last_became_active":"2023-11-24T06:14:35.569055+0000","last_became_peered":"2023-11-24T06:14:35.569055+0000","last_unstale":"2023-11-24T06:14:37.621770+0000","last_undegraded":"2023-11-24T06:14:37.621770+0000","last_fullsized":"2023-11-24T06:14:37.621770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:31:46.317904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621519+0000","last_change":"2023-11-24T06:14:36.581900+0000","last_active":"2023-11-24T06:14:37.621519+0000","last_peered":"2023-11-24T06:14:37.621519+0000","last_clean":"2023-11-24T06:14:37.621519+0000","last_became_active":"2023-11-24T06:14:36.581599+0000","last_became_peered":"2023-11-24T06:14:36.581599+0000","last_unstale":"2023-11-24T06:14:37.621519+0000","last_undegraded":"2023-11-24T06:14:37.621519+0000","last_fullsized":"2023-11-24T06:14:37.621519+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:27.288108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562719+0000","last_change":"2023-11-24T06:14:35.571906+0000","last_active":"2023-11-24T06:14:37.562719+0000","last_peered":"2023-11-24T06:14:37.562719+0000","last_clean":"2023-11-24T06:14:37.562719+0000","last_became_active":"2023-11-24T06:14:35.571645+0000","last_became_peered":"2023-11-24T06:14:35.571645+0000","last_unstale":"2023-11-24T06:14:37.562719+0000","last_undegraded":"2023-11-24T06:14:37.562719+0000","last_fullsized":"2023-11-24T06:14:37.562719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:24:50.028567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622735+0000","last_change":"2023-11-24T06:14:36.579107+0000","last_active":"2023-11-24T06:14:37.622735+0000","last_peered":"2023-11-24T06:14:37.622735+0000","last_clean":"2023-11-24T06:14:37.622735+0000","last_became_active":"2023-11-24T06:14:36.578818+0000","last_became_peered":"2023-11-24T06:14:36.578818+0000","last_unstale":"2023-11-24T06:14:37.622735+0000","last_undegraded":"2023-11-24T06:14:37.622735+0000","last_fullsized":"2023-11-24T06:14:37.622735+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563371+0000","last_change":"2023-11-24T06:14:35.571156+0000","last_active":"2023-11-24T06:14:37.563371+0000","last_peered":"2023-11-24T06:14:37.563371+0000","last_clean":"2023-11-24T06:14:37.563371+0000","last_became_active":"2023-11-24T06:14:35.569847+0000","last_became_peered":"2023-11-24T06:14:35.569847+0000","last_unstale":"2023-11-24T06:14:37.563371+0000","last_undegraded":"2023-11-24T06:14:37.563371+0000","last_fullsized":"2023-11-24T06:14:37.563371+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563040+0000","last_change":"2023-11-24T06:14:36.579084+0000","last_active":"2023-11-24T06:14:37.563040+0000","last_peered":"2023-11-24T06:14:37.563040+0000","last_clean":"2023-11-24T06:14:37.563040+0000","last_became_active":"2023-11-24T06:14:36.578808+0000","last_became_peered":"2023-11-24T06:14:36.578808+0000","last_unstale":"2023-11-24T06:14:37.563040+0000","last_undegraded":"2023-11-24T06:14:37.563040+0000","last_fullsized":"2023-11-24T06:14:37.563040+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T10:07:44.345339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562144+0000","last_change":"2023-11-24T06:14:35.564056+0000","last_active":"2023-11-24T06:14:37.562144+0000","last_peered":"2023-11-24T06:14:37.562144+0000","last_clean":"2023-11-24T06:14:37.562144+0000","last_became_active":"2023-11-24T06:14:35.563728+0000","last_became_peered":"2023-11-24T06:14:35.563728+0000","last_unstale":"2023-11-24T06:14:37.562144+0000","last_undegraded":"2023-11-24T06:14:37.562144+0000","last_fullsized":"2023-11-24T06:14:37.562144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:01:41.888587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622705+0000","last_change":"2023-11-24T06:14:36.572005+0000","last_active":"2023-11-24T06:14:37.622705+0000","last_peered":"2023-11-24T06:14:37.622705+0000","last_clean":"2023-11-24T06:14:37.622705+0000","last_became_active":"2023-11-24T06:14:36.571591+0000","last_became_peered":"2023-11-24T06:14:36.571591+0000","last_unstale":"2023-11-24T06:14:37.622705+0000","last_undegraded":"2023-11-24T06:14:37.622705+0000","last_fullsized":"2023-11-24T06:14:37.622705+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:12:55.093068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562977+0000","last_change":"2023-11-24T06:14:35.566812+0000","last_active":"2023-11-24T06:14:37.562977+0000","last_peered":"2023-11-24T06:14:37.562977+0000","last_clean":"2023-11-24T06:14:37.562977+0000","last_became_active":"2023-11-24T06:14:35.566512+0000","last_became_peered":"2023-11-24T06:14:35.566512+0000","last_unstale":"2023-11-24T06:14:37.562977+0000","last_undegraded":"2023-11-24T06:14:37.562977+0000","last_fullsized":"2023-11-24T06:14:37.562977+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:10.329976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563179+0000","last_change":"2023-11-24T06:14:36.577174+0000","last_active":"2023-11-24T06:14:37.563179+0000","last_peered":"2023-11-24T06:14:37.563179+0000","last_clean":"2023-11-24T06:14:37.563179+0000","last_became_active":"2023-11-24T06:14:36.576922+0000","last_became_peered":"2023-11-24T06:14:36.576922+0000","last_unstale":"2023-11-24T06:14:37.563179+0000","last_undegraded":"2023-11-24T06:14:37.563179+0000","last_fullsized":"2023-11-24T06:14:37.563179+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T17:45:29.958316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.562010+0000","last_change":"2023-11-24T06:14:35.567598+0000","last_active":"2023-11-24T06:14:37.562010+0000","last_peered":"2023-11-24T06:14:37.562010+0000","last_clean":"2023-11-24T06:14:37.562010+0000","last_became_active":"2023-11-24T06:14:35.567308+0000","last_became_peered":"2023-11-24T06:14:35.567308+0000","last_unstale":"2023-11-24T06:14:37.562010+0000","last_undegraded":"2023-11-24T06:14:37.562010+0000","last_fullsized":"2023-11-24T06:14:37.562010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621154+0000","last_change":"2023-11-24T06:14:36.573722+0000","last_active":"2023-11-24T06:14:37.621154+0000","last_peered":"2023-11-24T06:14:37.621154+0000","last_clean":"2023-11-24T06:14:37.621154+0000","last_became_active":"2023-11-24T06:14:36.573513+0000","last_became_peered":"2023-11-24T06:14:36.573513+0000","last_unstale":"2023-11-24T06:14:37.621154+0000","last_undegraded":"2023-11-24T06:14:37.621154+0000","last_fullsized":"2023-11-24T06:14:37.621154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T06:47:38.665431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563373+0000","last_change":"2023-11-24T06:14:35.570379+0000","last_active":"2023-11-24T06:14:37.563373+0000","last_peered":"2023-11-24T06:14:37.563373+0000","last_clean":"2023-11-24T06:14:37.563373+0000","last_became_active":"2023-11-24T06:14:35.570088+0000","last_became_peered":"2023-11-24T06:14:35.570088+0000","last_unstale":"2023-11-24T06:14:37.563373+0000","last_undegraded":"2023-11-24T06:14:37.563373+0000","last_fullsized":"2023-11-24T06:14:37.563373+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T08:30:34.799935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.563125+0000","last_change":"2023-11-24T06:14:36.573948+0000","last_active":"2023-11-24T06:14:37.563125+0000","last_peered":"2023-11-24T06:14:37.563125+0000","last_clean":"2023-11-24T06:14:37.563125+0000","last_became_active":"2023-11-24T06:14:36.573655+0000","last_became_peered":"2023-11-24T06:14:36.573655+0000","last_unstale":"2023-11-24T06:14:37.563125+0000","last_undegraded":"2023-11-24T06:14:37.563125+0000","last_fullsized":"2023-11-24T06:14:37.563125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T12:07:11.336643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.621610+0000","last_change":"2023-11-24T06:14:35.569259+0000","last_active":"2023-11-24T06:14:37.621610+0000","last_peered":"2023-11-24T06:14:37.621610+0000","last_clean":"2023-11-24T06:14:37.621610+0000","last_became_active":"2023-11-24T06:14:35.568995+0000","last_became_peered":"2023-11-24T06:14:35.568995+0000","last_unstale":"2023-11-24T06:14:37.621610+0000","last_undegraded":"2023-11-24T06:14:37.621610+0000","last_fullsized":"2023-11-24T06:14:37.621610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T16:23:58.810136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622671+0000","last_change":"2023-11-24T06:14:36.575376+0000","last_active":"2023-11-24T06:14:37.622671+0000","last_peered":"2023-11-24T06:14:37.622671+0000","last_clean":"2023-11-24T06:14:37.622671+0000","last_became_active":"2023-11-24T06:14:36.575108+0000","last_became_peered":"2023-11-24T06:14:36.575108+0000","last_unstale":"2023-11-24T06:14:37.622671+0000","last_undegraded":"2023-11-24T06:14:37.622671+0000","last_fullsized":"2023-11-24T06:14:37.622671+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:35.544664+0000","last_clean_scrub_stamp":"2023-11-24T06:14:35.544664+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T14:35:23.978395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-11-24T06:14:37.622132+0000","last_change":"2023-11-24T06:14:35.566472+0000","last_active":"2023-11-24T06:14:37.622132+0000","last_peered":"2023-11-24T06:14:37.622132+0000","last_clean":"2023-11-24T06:14:37.622132+0000","last_became_active":"2023-11-24T06:14:35.566180+0000","last_became_peered":"2023-11-24T06:14:35.566180+0000","last_unstale":"2023-11-24T06:14:37.622132+0000","last_undegraded":"2023-11-24T06:14:37.622132+0000","last_fullsized":"2023-11-24T06:14:37.622132+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:14:34.537997+0000","last_clean_scrub_stamp":"2023-11-24T06:14:34.537997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T07:54:26.281441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-24T06:14:36.566122+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:36.566122+0000","last_peered":"2023-11-24T06:14:36.566122+0000","last_clean":"2023-11-24T06:14:36.566122+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:36.566122+0000","last_undegraded":"2023-11-24T06:14:36.566122+0000","last_fullsized":"2023-11-24T06:14:36.566122+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":730750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.44}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.54600000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.41699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.499},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.41799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.441}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56499999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.61799999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66400000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.40799999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.433}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.624},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.505},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":954368,"data_stored":730660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.28000000000000003},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.314}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.42199999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.38100000000000001},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.33100000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.65400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35799999999999998},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.378}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.39900000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.72699999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.82099999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.70899999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.80400000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27392,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344448,"statfs":{"total":96636764160,"available":96608714752,"internally_reserved":0,"allocated":376832,"data_stored":141926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.26600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.252},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.318}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":1.605},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.53900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":1.5629999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.6220000000000001},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.56999999999999995}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":1.5780000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.496}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56799999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.379}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.442},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.51200000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":140292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.435},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.53000000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.626},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40899999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.505}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.59399999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60999999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:14:41.371 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-24T06:14:41.371 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-24T06:14:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.530+0000 7fb5088e3700 1 Processor -- start 2023-11-24T06:14:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.531+0000 7fb5088e3700 1 -- start start 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb5088e3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50406e370 0x7fb50415b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb5088e3700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50415e9f0 con 0x7fb50406b0f0 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb5088e3700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50415ec90 con 0x7fb5040b49a0 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb5088e3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50415ef70 con 0x7fb50406e370 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb502d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb50406b0f0 0x7fb50406b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40042/0 (socket says 172.21.15.106:40042) 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb502d9d700 1 -- 172.21.15.106:0/598364981 learned_addr learned my addr 172.21.15.106:0/598364981 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960416524 0 0) 0x7fb50415e9f0 con 0x7fb50406b0f0 2023-11-24T06:14:41.537 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4ec0035b0 con 0x7fb50406b0f0 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb501d9b700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50406e370 0x7fb50415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296102645 0 0) 0x7fb4ec0035b0 con 0x7fb50406b0f0 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50406e370 msgr2=0x7fb50415b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50406e370 0x7fb50415b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 >> v1:172.21.15.176:6789/0 conn(0x7fb5040b49a0 legacy=0x7fb5040b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50415f250 con 0x7fb50406b0f0 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb4fc0019f0 con 0x7fb50406b0f0 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 >> v1:172.21.15.106:6789/0 conn(0x7fb50406b0f0 legacy=0x7fb50406b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4ec003a30 0x7fb4ec003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4ec004850 0x7fb4ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb4ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.538 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50415ef70 con 0x7fb4ec005330 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec00c1e0 con 0x7fb4ec004850 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ec00c3a0 con 0x7fb4ec003a30 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb501d9b700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb50406e370 0x7fb50415b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.532+0000 7fb502d9d700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb4ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb50259c700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4ec003a30 0x7fb4ec003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb501d9b700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4ec004850 0x7fb4ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 -- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4ec003a30 msgr2=0x7fb4ec003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4ec003a30 0x7fb4ec003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 -- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4ec004850 msgr2=0x7fb4ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4ec004850 0x7fb4ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 -- 172.21.15.106:0/598364981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4ec0035b0 con 0x7fb4ec005330 2023-11-24T06:14:41.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb502d9d700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb4ec00ba10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00a810 tx=0x7fb4ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476f42e815675eef server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc00a250 con 0x7fb4ec005330 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4fc012620 con 0x7fb4ec005330 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb50159a700 1 -- 172.21.15.106:0/598364981 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4fc0129d0 con 0x7fb4ec005330 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb5088e3700 1 -- 172.21.15.106:0/598364981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 msgr2=0x7fb4ec00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.533+0000 7fb5088e3700 1 --2- 172.21.15.106:0/598364981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb4ec00ba10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb4fc00a810 tx=0x7fb4ec005880 comp rx=0 tx=0).stop 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.534+0000 7fb502d9d700 1 -- 172.21.15.106:0/598364981 reap_dead start 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.534+0000 7fb5088e3700 1 -- 172.21.15.106:0/598364981 shutdown_connections 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.534+0000 7fb5088e3700 1 -- 172.21.15.106:0/598364981 >> 172.21.15.106:0/598364981 conn(0x7fb5040b28f0 msgr2=0x7fb5040b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.534+0000 7fb5088e3700 1 -- 172.21.15.106:0/598364981 shutdown_connections 2023-11-24T06:14:41.540 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.534+0000 7fb5088e3700 1 -- 172.21.15.106:0/598364981 wait complete. 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.535+0000 7fb5088e3700 1 Processor -- start 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.535+0000 7fb5088e3700 1 -- start start 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5040ae740 0x7fb504159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50415d750 0x7fb50415dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50415e110 con 0x7fb4ec005330 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040aeeb0 con 0x7fb50415d750 2023-11-24T06:14:41.543 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040af190 con 0x7fb5040ae740 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59788/0 (socket says 172.21.15.106:59788) 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 -- 172.21.15.106:0/936003831 learned_addr learned my addr 172.21.15.106:0/936003831 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb501d9b700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5040ae740 0x7fb504159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 -- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5040ae740 msgr2=0x7fb504159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5040ae740 0x7fb504159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 -- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50415d750 msgr2=0x7fb50415dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50415d750 0x7fb50415dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 -- 172.21.15.106:0/936003831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040af470 con 0x7fb4ec005330 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb50259c700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80119d0 tx=0x7fb4f8011d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f80054e0 con 0x7fb4ec005330 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f800f7d0 con 0x7fb4ec005330 2023-11-24T06:14:41.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040af750 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800fb80 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.536+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5040aebc0 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.537+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb504068fb0 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.538+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4f8018020 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.538+0000 7fb4f2ffd700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.538+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4f808b440 con 0x7fb4ec005330 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.538+0000 7fb501d9b700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.539+0000 7fb501d9b700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5040682d0 tx=0x7fb4f4008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.546 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.543+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb4f8056450 con 0x7fb4ec005330 2023-11-24T06:14:41.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.813+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb50406e150 con 0x7fb4ec005330 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.815+0000 7fb4f2ffd700 1 -- 172.21.15.106:0/936003831 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7fb4f8059a70 con 0x7fb4ec005330 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDaPmBl1j6aIxAAAR3xrON0w7ObmiN+s8p//g== 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stdout: caps mds = "allow" 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stdout: caps mon = "allow r" 2023-11-24T06:14:41.818 INFO:teuthology.orchestra.run.smithi106.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-24T06:14:41.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.817+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 msgr2=0x7fb4e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.817+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5040682d0 tx=0x7fb4f4008040 comp rx=0 tx=0).stop 2023-11-24T06:14:41.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.817+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 msgr2=0x7fb504149150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.817+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb4f80119d0 tx=0x7fb4f8011d90 comp rx=0 tx=0).stop 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 shutdown_connections 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4e406aed0 0x7fb4e406d390 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb50415d750 0x7fb50415dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4ec005330 0x7fb504149150 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 --2- 172.21.15.106:0/936003831 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb5040ae740 0x7fb504159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 >> 172.21.15.106:0/936003831 conn(0x7fb5040b28f0 msgr2=0x7fb50406e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 shutdown_connections 2023-11-24T06:14:41.821 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.818+0000 7fb5088e3700 1 -- 172.21.15.106:0/936003831 wait complete. 2023-11-24T06:14:41.822 INFO:teuthology.orchestra.run.smithi106.stderr:updated caps for client.0 2023-11-24T06:14:41.832 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:41.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.951+0000 7fda5dc37700 1 Processor -- start 2023-11-24T06:14:41.954 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.951+0000 7fda5dc37700 1 -- start start 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda5dc37700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda5815e080 0x7fda580b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda5dc37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda5dc37700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda580ae430 con 0x7fda580af4d0 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda5dc37700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda580af0b0 con 0x7fda5815e080 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda5dc37700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda580b05a0 con 0x7fda5806c710 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda57fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda577fe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda5815e080 0x7fda580b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda57fff700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:42020/0 (socket says 172.21.15.106:42020) 2023-11-24T06:14:41.955 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.952+0000 7fda57fff700 1 -- 172.21.15.106:0/4067984235 learned_addr learned my addr 172.21.15.106:0/4067984235 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda577fe700 1 -- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 msgr2=0x7fda580afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda577fe700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda577fe700 1 -- 172.21.15.106:0/4067984235 >> v1:172.21.15.176:6789/0 conn(0x7fda580af4d0 legacy=0x7fda5806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda577fe700 1 -- 172.21.15.106:0/4067984235 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda580ae710 con 0x7fda5815e080 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda57fff700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:41.957 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda577fe700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda580b5050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda48009870 tx=0x7fda48009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c855555b935bdcee server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda56ffd700 1 -- 172.21.15.106:0/4067984235 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48011830 con 0x7fda5815e080 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda56ffd700 1 -- 172.21.15.106:0/4067984235 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48011990 con 0x7fda5815e080 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.953+0000 7fda56ffd700 1 -- 172.21.15.106:0/4067984235 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48011d20 con 0x7fda5815e080 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 -- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 msgr2=0x7fda580b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda580b5050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fda48009870 tx=0x7fda48009b80 comp rx=0 tx=0).stop 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 -- 172.21.15.106:0/4067984235 shutdown_connections 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda580afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 --2- 172.21.15.106:0/4067984235 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda580b5050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.958 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 -- 172.21.15.106:0/4067984235 >> 172.21.15.106:0/4067984235 conn(0x7fda58071b90 msgr2=0x7fda58071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:41.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 -- 172.21.15.106:0/4067984235 shutdown_connections 2023-11-24T06:14:41.959 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.954+0000 7fda5dc37700 1 -- 172.21.15.106:0/4067984235 wait complete. 2023-11-24T06:14:41.961 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.955+0000 7fda5dc37700 1 Processor -- start 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 -- start start 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda581533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda5815f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda580c5de0 con 0x7fda580af4d0 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda58153910 con 0x7fda5815e080 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda5dc37700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda58156420 con 0x7fda5806c710 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.956+0000 7fda4effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59804/0 (socket says 172.21.15.106:59804) 2023-11-24T06:14:41.962 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 -- 172.21.15.106:0/1082819029 learned_addr learned my addr 172.21.15.106:0/1082819029 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda57fff700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda5815f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda577fe700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda581533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 -- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 msgr2=0x7fda581533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda581533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 -- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 msgr2=0x7fda5815f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda5815f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 -- 172.21.15.106:0/1082819029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda50009b30 con 0x7fda580af4d0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda577fe700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda581533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda4effd700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c4b0 tx=0x7fda4000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400052d0 con 0x7fda580af4d0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40005430 con 0x7fda580af4d0 2023-11-24T06:14:41.963 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda400038c0 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda480094a0 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.957+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda58157380 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.958+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda581579d0 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.959+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda40003a20 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.959+0000 7fda54ff9700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 0x7fda3806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.959+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda40088a70 con 0x7fda580af4d0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.959+0000 7fda577fe700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 0x7fda3806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:41.964 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.960+0000 7fda577fe700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 0x7fda3806d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda480090b0 tx=0x7fda4801c040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:41.966 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:41.964+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda40053a90 con 0x7fda580af4d0 2023-11-24T06:14:42.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.195+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda580753f0 con 0x7fda580af4d0 2023-11-24T06:14:42.198 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.195+0000 7fda54ff9700 1 -- 172.21.15.106:0/1082819029 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fda40017020 con 0x7fda580af4d0 2023-11-24T06:14:42.198 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:42.198 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:42.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 msgr2=0x7fda3806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 0x7fda3806d390 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fda480090b0 tx=0x7fda4801c040 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 msgr2=0x7fda58155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fda4000c4b0 tx=0x7fda4000c7c0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 shutdown_connections 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda3806aed0 0x7fda3806d390 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda5815e080 0x7fda5815f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda5806c710 0x7fda581533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 --2- 172.21.15.106:0/1082819029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda580af4d0 0x7fda58155920 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.201 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 >> 172.21.15.106:0/1082819029 conn(0x7fda58071b90 msgr2=0x7fda580b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 shutdown_connections 2023-11-24T06:14:42.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.198+0000 7fda5dc37700 1 -- 172.21.15.106:0/1082819029 wait complete. 2023-11-24T06:14:42.202 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 17 2023-11-24T06:14:42.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-24T06:14:35.950673+0000', 'modified': '2023-11-24T06:14:39.291793+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5088}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5088': {'gid': 5088, 'name': 'b', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.176:6835/2432507264', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.176:6833', 'nonce': 2432507264}, {'type': 'v1', 'addr': '172.21.15.176:6835', 'nonce': 2432507264}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-24T06:14:42.616 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-24T06:14:42.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-11-24T06:14:42.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.739+0000 7fce4b996700 1 Processor -- start 2023-11-24T06:14:42.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.739+0000 7fce4b996700 1 -- start start 2023-11-24T06:14:42.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce4b996700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce4415e080 0x7fce440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce4b996700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce440af4d0 0x7fce440afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce4b996700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce440ae430 con 0x7fce4406c000 2023-11-24T06:14:42.744 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce4b996700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce440af0b0 con 0x7fce440af4d0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce4b996700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce440b05a0 con 0x7fce4415e080 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce440af4d0 0x7fce440afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce440af4d0 0x7fce440afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59812/0 (socket says 172.21.15.106:59812) 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 -- 172.21.15.106:0/1936031025 learned_addr learned my addr 172.21.15.106:0/1936031025 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce49732700 1 --2- 172.21.15.106:0/1936031025 >> v2:172.21.15.176:3300/0 conn(0x7fce4415e080 0x7fce440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 -- 172.21.15.106:0/1936031025 >> v2:172.21.15.176:3300/0 conn(0x7fce4415e080 msgr2=0x7fce440b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 --2- 172.21.15.106:0/1936031025 >> v2:172.21.15.176:3300/0 conn(0x7fce4415e080 0x7fce440b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 -- 172.21.15.106:0/1936031025 >> v1:172.21.15.176:6789/0 conn(0x7fce4406c000 legacy=0x7fce44073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 -- 172.21.15.106:0/1936031025 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce440ae710 con 0x7fce440af4d0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce48f31700 1 --2- 172.21.15.106:0/1936031025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440af4d0 0x7fce440afb90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fce44072a90 tx=0x7fce34009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1641be6e1373ae47 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.740+0000 7fce3bfff700 1 -- 172.21.15.106:0/1936031025 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400b860 con 0x7fce440af4d0 2023-11-24T06:14:42.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce3bfff700 1 -- 172.21.15.106:0/1936031025 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400b9c0 con 0x7fce440af4d0 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce3bfff700 1 -- 172.21.15.106:0/1936031025 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400bd50 con 0x7fce440af4d0 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 -- 172.21.15.106:0/1936031025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440af4d0 msgr2=0x7fce440afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 --2- 172.21.15.106:0/1936031025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440af4d0 0x7fce440afb90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fce44072a90 tx=0x7fce34009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 -- 172.21.15.106:0/1936031025 shutdown_connections 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 --2- 172.21.15.106:0/1936031025 >> v2:172.21.15.176:3300/0 conn(0x7fce4415e080 0x7fce440b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 --2- 172.21.15.106:0/1936031025 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce440af4d0 0x7fce440afb90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 -- 172.21.15.106:0/1936031025 >> 172.21.15.106:0/1936031025 conn(0x7fce44071b90 msgr2=0x7fce44071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 -- 172.21.15.106:0/1936031025 shutdown_connections 2023-11-24T06:14:42.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.741+0000 7fce4b996700 1 -- 172.21.15.106:0/1936031025 wait complete. 2023-11-24T06:14:42.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.742+0000 7fce4b996700 1 Processor -- start 2023-11-24T06:14:42.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.742+0000 7fce4b996700 1 -- start start 2023-11-24T06:14:42.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406c000 0x7fce441583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440af4d0 0x7fce44154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44155860 con 0x7fce4415e080 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44154690 con 0x7fce4406c000 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce4b996700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce44154910 con 0x7fce440af4d0 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59820/0 (socket says 172.21.15.106:59820) 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 -- 172.21.15.106:0/2486548696 learned_addr learned my addr 172.21.15.106:0/2486548696 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49732700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406c000 0x7fce441583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce48f31700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440af4d0 0x7fce44154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 -- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440af4d0 msgr2=0x7fce44154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440af4d0 0x7fce44154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 -- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406c000 msgr2=0x7fce441583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406c000 0x7fce441583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.743+0000 7fce49f33700 1 -- 172.21.15.106:0/2486548696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34009550 con 0x7fce4415e080 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce49f33700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cc50 tx=0x7fce3c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce39ffb700 1 -- 172.21.15.106:0/2486548696 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c003c00 con 0x7fce4415e080 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce39ffb700 1 -- 172.21.15.106:0/2486548696 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c003d60 con 0x7fce4415e080 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce44154bf0 con 0x7fce4415e080 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce39ffb700 1 -- 172.21.15.106:0/2486548696 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00aab0 con 0x7fce4415e080 2023-11-24T06:14:42.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.744+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce441551b0 con 0x7fce4415e080 2023-11-24T06:14:42.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.745+0000 7fce39ffb700 1 -- 172.21.15.106:0/2486548696 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce3c00ac10 con 0x7fce4415e080 2023-11-24T06:14:42.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.746+0000 7fce39ffb700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 0x7fce2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.746+0000 7fce49732700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 0x7fce2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.746+0000 7fce39ffb700 1 -- 172.21.15.106:0/2486548696 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce3c0895b0 con 0x7fce4415e080 2023-11-24T06:14:42.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.746+0000 7fce49732700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 0x7fce2806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce40007a30 tx=0x7fce40008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.748+0000 7fce57b8fb80 1 Processor -- start 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.748+0000 7fce57b8fb80 1 -- start start 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5f080 0x5585e4fa5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4f88e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4ed2770 con 0x5585e4f74ed0 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4eb9750 con 0x5585e4f5f080 2023-11-24T06:14:42.758 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585e4eb7070 con 0x5585e4f5c490 2023-11-24T06:14:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59826/0 (socket says 172.21.15.106:59826) 2023-11-24T06:14:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 -- 172.21.15.106:0/817337963 learned_addr learned my addr 172.21.15.106:0/817337963 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.759 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce49732700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5f080 0x5585e4fa5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce49f33700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4f88e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 -- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 msgr2=0x5585e4f88e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4f88e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 -- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5f080 msgr2=0x5585e4fa5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5f080 0x5585e4fa5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce48f31700 1 -- 172.21.15.106:0/817337963 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e4d2f5e0 con 0x5585e4f74ed0 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.749+0000 7fce49f33700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4f88e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce48f31700 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce34010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca2c650f28c28cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.760 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce2effd700 1 -- 172.21.15.106:0/817337963 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34020070 con 0x5585e4f74ed0 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce2effd700 1 -- 172.21.15.106:0/817337963 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400b6e0 con 0x5585e4f74ed0 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce2effd700 1 -- 172.21.15.106:0/817337963 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3400b850 con 0x5585e4f74ed0 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 -- 172.21.15.106:0/817337963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 msgr2=0x5585e4fa5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fce34009870 tx=0x7fce34010000 comp rx=0 tx=0).stop 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 -- 172.21.15.106:0/817337963 shutdown_connections 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4f88e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5f080 0x5585e4fa5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/817337963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f74ed0 0x5585e4fa5d80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 -- 172.21.15.106:0/817337963 >> 172.21.15.106:0/817337963 conn(0x5585e4e8d310 msgr2=0x5585e4fa3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.761 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 -- 172.21.15.106:0/817337963 shutdown_connections 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.750+0000 7fce57b8fb80 1 -- 172.21.15.106:0/817337963 wait complete. 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.751+0000 7fce57b8fb80 1 -- start start 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.751+0000 7fce57b8fb80 1 Processor -- start 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4fb2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4f53330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4eb2960 con 0x5585e4f5f080 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4e6c510 con 0x5585e4f74ed0 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585e4e6c1b0 con 0x5585e4f5c490 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce57b8fb80 10 client.0 _ll_register_callbacks cb 0x5585e4d97a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:14:42.762 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59832/0 (socket says 172.21.15.106:59832) 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 -- 172.21.15.106:0/2307254827 learned_addr learned my addr 172.21.15.106:0/2307254827 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce49732700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4fb2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce49f33700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4f53330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 -- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 msgr2=0x5585e4fb2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4fb2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 -- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 msgr2=0x5585e4f53330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4f53330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.752+0000 7fce48f31700 1 -- 172.21.15.106:0/2307254827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce440ae710 con 0x5585e4f5f080 2023-11-24T06:14:42.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce48f31700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fce34013000 tx=0x7fce340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e2bff7e5c82149 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031070 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce34004250 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585e4f51a40 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce34004430 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 10 client.5253 fetch_fsmap learned FSMap version 17 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5585e4cdbd90 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5585e4f51a40 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce34034020 con 0x5585e4f5f080 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 10 client.5253 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:14:42.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 10 client.5253 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 20 client.5253 populate_metadata read hostname 'smithi106' 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f76e40 0x5585e4f8a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 4 client.5253 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.753+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 --> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585e4f2d840 con 0x5585e4f76e40 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.754+0000 7fce49732700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f76e40 0x5585e4f8a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.754+0000 7fce23fff700 10 client.5253 ms_handle_connect on v2:172.21.15.176:6833/2432507264 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.754+0000 7fce49732700 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f76e40 0x5585e4f8a010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc41b37209d4033f server_cookie=a8afd19cbb1866f5 in_seq=0 out_seq=0 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce23fff700 1 -- 172.21.15.106:0/2307254827 <== mds.0 v2:172.21.15.176:6833/2432507264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5585e4f2d840 con 0x5585e4f76e40 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce23fff700 10 client.5253 handle_command_reply: tid=0 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 client.5253 shutdown 2023-11-24T06:14:42.765 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 msgr2=0x5585e4f877f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fce34013000 tx=0x7fce340047c0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 shutdown_connections 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f76e40 0x5585e4f8a010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4f53330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e4fb2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/2307254827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4f877f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce23fff700 0 client.5253 ms_handle_reset on v2:172.21.15.176:6833/2432507264 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 >> 172.21.15.106:0/2307254827 conn(0x5585e4e8d310 msgr2=0x5585e4fa7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 shutdown_connections 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 1 -- 172.21.15.106:0/2307254827 wait complete. 2023-11-24T06:14:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.755+0000 7fce57b8fb80 20 client.5253 trim_cache size 0 max 16384 2023-11-24T06:14:42.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.773+0000 7fce57b8fb80 1 Processor -- start 2023-11-24T06:14:42.776 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.773+0000 7fce57b8fb80 1 -- start start 2023-11-24T06:14:42.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5c490 0x5585e4fc5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.778 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f74ed0 0x5585e4f52ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4d318d0 con 0x5585e4f5f080 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4f5b380 con 0x5585e4f5c490 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585e4fa3600 con 0x5585e4f74ed0 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59840/0 (socket says 172.21.15.106:59840) 2023-11-24T06:14:42.779 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 -- 172.21.15.106:0/779335003 learned_addr learned my addr 172.21.15.106:0/779335003 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 -- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f74ed0 msgr2=0x5585e4f52ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce49f33700 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f74ed0 0x5585e4f52ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce49732700 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5c490 0x5585e4fc5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f74ed0 0x5585e4f52ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 -- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5c490 msgr2=0x5585e4fc5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5c490 0x5585e4fc5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 -- 172.21.15.106:0/779335003 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585e4cc4c10 con 0x5585e4f5f080 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce48f31700 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce34000c00 tx=0x7fce3400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2b9c8f63b8e05de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce2f7fe700 1 -- 172.21.15.106:0/779335003 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031040 con 0x5585e4f5f080 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce2f7fe700 1 -- 172.21.15.106:0/779335003 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340037e0 con 0x5585e4f5f080 2023-11-24T06:14:42.780 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.774+0000 7fce2f7fe700 1 -- 172.21.15.106:0/779335003 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34003b90 con 0x5585e4f5f080 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 -- 172.21.15.106:0/779335003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 msgr2=0x5585e4fa6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fce34000c00 tx=0x7fce3400b050 comp rx=0 tx=0).stop 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 -- 172.21.15.106:0/779335003 shutdown_connections 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f74ed0 0x5585e4f52ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f5c490 0x5585e4fc5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/779335003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fa6ce0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 -- 172.21.15.106:0/779335003 >> 172.21.15.106:0/779335003 conn(0x5585e4e8d310 msgr2=0x5585e4fa57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 -- 172.21.15.106:0/779335003 shutdown_connections 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.775+0000 7fce57b8fb80 1 -- 172.21.15.106:0/779335003 wait complete. 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.776+0000 7fce57b8fb80 1 -- start start 2023-11-24T06:14:42.781 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.776+0000 7fce57b8fb80 1 Processor -- start 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e500bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4fc2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4fc3ad0 con 0x5585e4f5f080 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585e4f73c30 con 0x5585e4f74ed0 2023-11-24T06:14:42.785 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x5585e4f74160 con 0x5585e4f5c490 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce57b8fb80 10 client.0 _ll_register_callbacks cb 0x5585e4d97a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59846/0 (socket says 172.21.15.106:59846) 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 -- 172.21.15.106:0/3234218302 learned_addr learned my addr 172.21.15.106:0/3234218302 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce49732700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e500bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce49f33700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4fc2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 -- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 msgr2=0x5585e500bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e500bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 -- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 msgr2=0x5585e4fc2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.786 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4fc2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.777+0000 7fce48f31700 1 -- 172.21.15.106:0/3234218302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585e4cdbd90 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce48f31700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fce3400b120 tx=0x7fce34008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ee2db09a3b3e0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031050 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mon.0 v2:172.21.15.106:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce34000e40 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fce3400b6e0 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce3400bbb0 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 10 client.5259 fetch_fsmap learned FSMap version 17 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5585e4d02200 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mon.0 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3400b6e0 con 0x5585e4f5f080 2023-11-24T06:14:42.787 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mon.0 v2:172.21.15.106:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fce34034020 con 0x5585e4f5f080 2023-11-24T06:14:42.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 10 client.5259 fetch_fsmap finished waiting for FSMap version 17 2023-11-24T06:14:42.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 10 client.5259 resolve_mds: resolved name 'b' to daemon mds.b 2023-11-24T06:14:42.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 20 client.5259 populate_metadata read hostname 'smithi106' 2023-11-24T06:14:42.789 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f89460 0x5585e4f89840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 4 client.5259 mds_command: new command op to 5088 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 --> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5585e4e78f80 con 0x5585e4f89460 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.778+0000 7fce49732700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f89460 0x5585e4f89840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce23fff700 10 client.5259 ms_handle_connect on v2:172.21.15.176:6833/2432507264 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce49732700 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f89460 0x5585e4f89840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc232445fdbbb01e server_cookie=33b99b826e3b7394 in_seq=0 out_seq=0 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce23fff700 1 -- 172.21.15.106:0/3234218302 <== mds.0 v2:172.21.15.176:6833/2432507264 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5585e4e78f80 con 0x5585e4f89460 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce23fff700 10 client.5259 handle_command_reply: tid=0 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 client.5259 shutdown 2023-11-24T06:14:42.790 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 msgr2=0x5585e4fc2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fce3400b120 tx=0x7fce34008030 comp rx=0 tx=0).stop 2023-11-24T06:14:42.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 shutdown_connections 2023-11-24T06:14:42.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:6833/2432507264,v1:172.21.15.176:6835/2432507264] conn(0x5585e4f89460 0x5585e4f89840 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x5585e4f74ed0 0x5585e4fc2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.791 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce23fff700 0 client.5259 ms_handle_reset on v2:172.21.15.176:6833/2432507264 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x5585e4f5c490 0x5585e500bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 --2- 172.21.15.106:0/3234218302 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5585e4f5f080 0x5585e4fc2aa0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 >> 172.21.15.106:0/3234218302 conn(0x5585e4e8d310 msgr2=0x5585e4f52ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 shutdown_connections 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 1 -- 172.21.15.106:0/3234218302 wait complete. 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.779+0000 7fce57b8fb80 20 client.5259 trim_cache size 0 max 16384 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:14:42.792 INFO:teuthology.orchestra.run.smithi106.stdout: "cluster_fsid": "2a42eb6f-5aad-4f8e-8067-d72b439cd81f", 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "whoami": 0, 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 5088, 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "want_state": "up:active", 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "up:active", 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs", 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "rank_uptime": 5.8838626449999998, 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsmap_epoch": 17, 2023-11-24T06:14:42.793 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch": 33, 2023-11-24T06:14:42.794 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_epoch_barrier": 33, 2023-11-24T06:14:42.794 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 14.205300233999999 2023-11-24T06:14:42.794 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 msgr2=0x7fce2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 0x7fce2806d390 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fce40007a30 tx=0x7fce40008040 comp rx=0 tx=0).stop 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 msgr2=0x7fce441483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00cc50 tx=0x7fce3c00cf60 comp rx=0 tx=0).stop 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 shutdown_connections 2023-11-24T06:14:42.795 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce2806aed0 0x7fce2806d390 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce4415e080 0x7fce441483d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce4406c000 0x7fce441583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 --2- 172.21.15.106:0/2486548696 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce440af4d0 0x7fce44154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 >> 172.21.15.106:0/2486548696 conn(0x7fce44071b90 msgr2=0x7fce4415d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 shutdown_connections 2023-11-24T06:14:42.796 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.780+0000 7fce4b996700 1 -- 172.21.15.106:0/2486548696 wait complete. 2023-11-24T06:14:42.796 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:42.917 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.915+0000 7fbc16693700 1 Processor -- start 2023-11-24T06:14:42.918 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.915+0000 7fbc16693700 1 -- start start 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.915+0000 7fbc16693700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbc100b3370 0x7fbc101604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.915+0000 7fbc16693700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbc100d1c70 0x7fbc100d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc16693700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc100b22d0 con 0x7fbc1015bdd0 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc16693700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc100b2f50 con 0x7fbc100b3370 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc16693700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc100d2640 con 0x7fbc100d1c70 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbc100b3370 0x7fbc101604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbc100b3370 0x7fbc101604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59854/0 (socket says 172.21.15.106:59854) 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/976070142 learned_addr learned my addr 172.21.15.106:0/976070142 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.920 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc14c30700 1 --2- 172.21.15.106:0/976070142 >> v2:172.21.15.176:3300/0 conn(0x7fbc100d1c70 0x7fbc100d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/976070142 >> v2:172.21.15.176:3300/0 conn(0x7fbc100d1c70 msgr2=0x7fbc100d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 --2- 172.21.15.106:0/976070142 >> v2:172.21.15.176:3300/0 conn(0x7fbc100d1c70 0x7fbc100d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/976070142 >> v1:172.21.15.176:6789/0 conn(0x7fbc1015bdd0 legacy=0x7fbc100b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/976070142 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100b25b0 con 0x7fbc100b3370 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0f7fe700 1 --2- 172.21.15.106:0/976070142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100b3370 0x7fbc101604e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbc10160a50 tx=0x7fbc04009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f3d1248481e763 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0effd700 1 -- 172.21.15.106:0/976070142 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011830 con 0x7fbc100b3370 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0effd700 1 -- 172.21.15.106:0/976070142 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc04011990 con 0x7fbc100b3370 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.916+0000 7fbc0effd700 1 -- 172.21.15.106:0/976070142 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04011d20 con 0x7fbc100b3370 2023-11-24T06:14:42.921 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 -- 172.21.15.106:0/976070142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100b3370 msgr2=0x7fbc101604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 --2- 172.21.15.106:0/976070142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100b3370 0x7fbc101604e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbc10160a50 tx=0x7fbc04009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 -- 172.21.15.106:0/976070142 shutdown_connections 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 --2- 172.21.15.106:0/976070142 >> v2:172.21.15.176:3300/0 conn(0x7fbc100d1c70 0x7fbc100d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 --2- 172.21.15.106:0/976070142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100b3370 0x7fbc101604e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 -- 172.21.15.106:0/976070142 >> 172.21.15.106:0/976070142 conn(0x7fbc100731a0 msgr2=0x7fbc1009aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 -- 172.21.15.106:0/976070142 shutdown_connections 2023-11-24T06:14:42.922 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.917+0000 7fbc16693700 1 -- 172.21.15.106:0/976070142 wait complete. 2023-11-24T06:14:42.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.918+0000 7fbc16693700 1 Processor -- start 2023-11-24T06:14:42.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.918+0000 7fbc16693700 1 -- start start 2023-11-24T06:14:42.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc100b3370 0x7fbc10156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc1015bdd0 0x7fbc100c6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100c57f0 con 0x7fbc100d1c70 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc100c6650 con 0x7fbc1015bdd0 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc16693700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc10157250 con 0x7fbc100b3370 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59860/0 (socket says 172.21.15.106:59860) 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/1234392103 learned_addr learned my addr 172.21.15.106:0/1234392103 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:42.925 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc14c30700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc1015bdd0 0x7fbc100c6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0ffff700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc100b3370 0x7fbc10156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc100b3370 msgr2=0x7fbc10156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc100b3370 0x7fbc10156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc1015bdd0 msgr2=0x7fbc100c6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc1015bdd0 0x7fbc100c6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 -- 172.21.15.106:0/1234392103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009550 con 0x7fbc100d1c70 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.919+0000 7fbc0f7fe700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc04000c00 tx=0x7fbc04004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.920+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc04004570 con 0x7fbc100d1c70 2023-11-24T06:14:42.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.920+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc0401f070 con 0x7fbc100d1c70 2023-11-24T06:14:42.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.920+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc100c5a40 con 0x7fbc100d1c70 2023-11-24T06:14:42.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.920+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040038e0 con 0x7fbc100d1c70 2023-11-24T06:14:42.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.920+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc100c6000 con 0x7fbc100d1c70 2023-11-24T06:14:42.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.921+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc100b01a0 con 0x7fbc100d1c70 2023-11-24T06:14:42.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.922+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbc04021030 con 0x7fbc100d1c70 2023-11-24T06:14:42.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.922+0000 7fbc0cff9700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 0x7fbbfc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:42.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.922+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc0408aec0 con 0x7fbc100d1c70 2023-11-24T06:14:42.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.922+0000 7fbc0ffff700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 0x7fbbfc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:42.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.923+0000 7fbc0ffff700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 0x7fbbfc06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc00000f60 tx=0x7fbc00009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:42.929 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:42.926+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbc04055fe0 con 0x7fbc100d1c70 2023-11-24T06:14:43.167 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.165+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc1015b8a0 con 0x7fbc100d1c70 2023-11-24T06:14:43.168 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.165+0000 7fbc0cff9700 1 -- 172.21.15.106:0/1234392103 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc04015070 con 0x7fbc100d1c70 2023-11-24T06:14:43.168 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:43.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 msgr2=0x7fbbfc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:43.170 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 0x7fbbfc06d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbc00000f60 tx=0x7fbc00009040 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 msgr2=0x7fbc100ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc04000c00 tx=0x7fbc04004750 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 shutdown_connections 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbbfc06aed0 0x7fbbfc06d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbc1015bdd0 0x7fbc100c6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbc100b3370 0x7fbc10156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 --2- 172.21.15.106:0/1234392103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc100d1c70 0x7fbc100ca570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.167+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 >> 172.21.15.106:0/1234392103 conn(0x7fbc100731a0 msgr2=0x7fbc100b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.168+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 shutdown_connections 2023-11-24T06:14:43.171 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:43.168+0000 7fbc16693700 1 -- 172.21.15.106:0/1234392103 wait complete. 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:43.182 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:14:43.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:14:43.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:43.183 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:43.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.183 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2023-11-24T06:14:43.200 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:43.200 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:43.200 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:14:43.201 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42360sec preferred_lft 42360sec 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::151c:cf3b:24ac:89aa/64 scope link noprefixroute 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:59:cb:85:54:39 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::80d2:3cff:fe26:794c/64 scope link 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether c6:59:cb:85:54:39 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:14:43.202 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c459:cbff:fe85:5439/64 scope link 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run.smithi106.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether ea:33:af:e5:d4:81 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::e833:afff:fee5:d481/64 scope link 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:43.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.203 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:43.265 INFO:teuthology.orchestra.run.smithi106.stdout:1 2023-11-24T06:14:43.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.266 DEBUG:teuthology.orchestra.run.smithi106:> route 2023-11-24T06:14:43.324 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2023-11-24T06:14:43.325 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:43.325 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:14:43.325 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:14:43.325 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:43.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.325 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2023-11-24T06:14:43.326 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2023-11-24T06:14:43.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:14:43.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:14:43.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:14:43.326 DEBUG:teuthology.orchestra.run.smithi106:> ') 2023-11-24T06:14:43.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.429 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:14:43.446 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:14:43.446 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:14:43.446 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:43.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.447 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2023-11-24T06:14:43.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:43.513 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:43.569 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-24T06:14:43.570 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:43.570 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:43.626 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:14:43.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.627 DEBUG:teuthology.orchestra.run.smithi106:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:14:43.711 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:14:43.711 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:14:43.712 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:43.721 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:14:43.721 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:14:43.721 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:43.721 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:43.721 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:invalid new device string format 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:14:43.748 INFO:teuthology.orchestra.run.smithi106.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:14:43.751 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:14:43.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:43.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:43.781 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:43.875 INFO:teuthology.orchestra.run.smithi106.stdout:client4921 2023-11-24T06:14:43.875 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:43.875 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:43.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-24T06:14:44.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.050+0000 7f1c26e84700 1 Processor -- start 2023-11-24T06:14:44.053 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.050+0000 7f1c26e84700 1 -- start start 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c26e84700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c201446a0 0x7f1c200b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c26e84700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c200af950 con 0x7f1c200adf00 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c26e84700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c200afc30 con 0x7f1c2006c710 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c26e84700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c20144a80 con 0x7f1c201446a0 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c24c20700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1c201446a0 0x7f1c200b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.055 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c1ffff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1c200adf00 0x7f1c2006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40132/0 (socket says 172.21.15.106:40132) 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c1ffff700 1 -- 172.21.15.106:0/2836341331 learned_addr learned my addr 172.21.15.106:0/2836341331 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c24c20700 1 -- 172.21.15.106:0/2836341331 >> v1:172.21.15.176:6789/0 conn(0x7f1c2006c710 legacy=0x7f1c200b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c24c20700 1 -- 172.21.15.106:0/2836341331 >> v1:172.21.15.106:6789/0 conn(0x7f1c200adf00 legacy=0x7f1c2006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c1f7fe700 1 -- 172.21.15.106:0/2836341331 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 93811351 0 0) 0x7f1c200af950 con 0x7f1c200adf00 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c24c20700 1 -- 172.21.15.106:0/2836341331 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c200aff10 con 0x7f1c201446a0 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.051+0000 7f1c24c20700 1 --2- 172.21.15.106:0/2836341331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c201446a0 0x7f1c200b5ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009840 tx=0x7f1c14009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9134559240ed1456 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.056 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c1f7fe700 1 -- 172.21.15.106:0/2836341331 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14004230 con 0x7f1c201446a0 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c1f7fe700 1 -- 172.21.15.106:0/2836341331 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14004390 con 0x7f1c201446a0 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c1f7fe700 1 -- 172.21.15.106:0/2836341331 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140036a0 con 0x7f1c201446a0 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 -- 172.21.15.106:0/2836341331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c201446a0 msgr2=0x7f1c200b5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 --2- 172.21.15.106:0/2836341331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c201446a0 0x7f1c200b5ae0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009840 tx=0x7f1c14009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 -- 172.21.15.106:0/2836341331 shutdown_connections 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 --2- 172.21.15.106:0/2836341331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c201446a0 0x7f1c200b5ae0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 -- 172.21.15.106:0/2836341331 >> 172.21.15.106:0/2836341331 conn(0x7f1c20071b90 msgr2=0x7f1c20071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:44.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 -- 172.21.15.106:0/2836341331 shutdown_connections 2023-11-24T06:14:44.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.052+0000 7f1c26e84700 1 -- 172.21.15.106:0/2836341331 wait complete. 2023-11-24T06:14:44.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.053+0000 7f1c26e84700 1 Processor -- start 2023-11-24T06:14:44.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.053+0000 7f1c26e84700 1 -- start start 2023-11-24T06:14:44.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 0x7f1c2009aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c201446a0 0x7f1c200ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015ce20 con 0x7f1c2006c710 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2013aaf0 con 0x7f1c200adf00 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c26e84700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2015c1a0 con 0x7f1c201446a0 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c24c20700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c24c20700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59876/0 (socket says 172.21.15.106:59876) 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c24c20700 1 -- 172.21.15.106:0/4291807104 learned_addr learned my addr 172.21.15.106:0/4291807104 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:44.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.054+0000 7f1c1ffff700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 0x7f1c2009aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c25421700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c201446a0 0x7f1c200ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 -- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c201446a0 msgr2=0x7f1c200ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c201446a0 0x7f1c200ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 -- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 msgr2=0x7f1c2009aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 0x7f1c2009aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 -- 172.21.15.106:0/4291807104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c140094a0 con 0x7f1c2006c710 2023-11-24T06:14:44.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c1ffff700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 0x7f1c2009aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c24c20700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c140047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14011830 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14011990 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c14011d40 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2015c480 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.055+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2015ca40 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.056+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c200753f0 con 0x7f1c2006c710 2023-11-24T06:14:44.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.056+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1c1401b440 con 0x7f1c2006c710 2023-11-24T06:14:44.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.057+0000 7f1c1d7fa700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 0x7f1c0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:44.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.057+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c1408aef0 con 0x7f1c2006c710 2023-11-24T06:14:44.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.057+0000 7f1c1ffff700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 0x7f1c0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:44.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.057+0000 7f1c1ffff700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 0x7f1c0406d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c200cc840 tx=0x7f1c0c007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:44.064 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.061+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c14056030 con 0x7f1c2006c710 2023-11-24T06:14:44.300 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.298+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c2015cbd0 con 0x7f1c2006c710 2023-11-24T06:14:44.301 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.298+0000 7f1c1d7fa700 1 -- 172.21.15.106:0/4291807104 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c1402a070 con 0x7f1c2006c710 2023-11-24T06:14:44.301 INFO:teuthology.orchestra.run.smithi106.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-24T06:14:44.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 msgr2=0x7f1c0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 0x7f1c0406d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1c200cc840 tx=0x7f1c0c007ca0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 msgr2=0x7f1c2013a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:44.303 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1c14000c00 tx=0x7f1c140047c0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 shutdown_connections 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1c0406aed0 0x7f1c0406d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1c201446a0 0x7f1c200ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c2006c710 0x7f1c2013a5b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 --2- 172.21.15.106:0/4291807104 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1c200adf00 0x7f1c2009aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 >> 172.21.15.106:0/4291807104 conn(0x7f1c20071b90 msgr2=0x7f1c2015dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.300+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 shutdown_connections 2023-11-24T06:14:44.304 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:44.301+0000 7f1c26e84700 1 -- 172.21.15.106:0/4291807104 wait complete. 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi176.front.sepia.ceph.com 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-24T06:14:44.315 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:44.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.316 DEBUG:teuthology.orchestra.run.smithi176:> ip addr 2023-11-24T06:14:44.337 INFO:teuthology.orchestra.run.smithi176.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-24T06:14:44.337 INFO:teuthology.orchestra.run.smithi176.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-24T06:14:44.337 INFO:teuthology.orchestra.run.smithi176.stdout: inet 127.0.0.1/8 scope host lo 2023-11-24T06:14:44.337 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.337 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 ::1/128 scope host 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:80 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:d9:36:81 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:60 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 0c:c4:7a:88:6f:61 brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:44.338 INFO:teuthology.orchestra.run.smithi176.stdout: inet 172.21.15.176/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::3daf:528e:a8b9:4250/64 scope link noprefixroute 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:63:7f:a6:52:0f brd ff:ff:ff:ff:ff:ff 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::ec28:6ff:fe6c:dae6/64 scope link 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether ca:fb:b9:5a:28:40 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:14:44.339 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::c8fb:b9ff:fe5a:2840/64 scope link 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run.smithi176.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run.smithi176.stdout: link/ether 5e:63:7f:a6:52:0f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run.smithi176.stdout: inet6 fe80::5c63:7fff:fea6:520f/64 scope link 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run.smithi176.stdout: valid_lft forever preferred_lft forever 2023-11-24T06:14:44.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.340 DEBUG:teuthology.orchestra.run.smithi176:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-24T06:14:44.407 INFO:teuthology.orchestra.run.smithi176.stdout:1 2023-11-24T06:14:44.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.409 DEBUG:teuthology.orchestra.run.smithi176:> route 2023-11-24T06:14:44.471 INFO:teuthology.orchestra.run.smithi176.stdout:Kernel IP routing table 2023-11-24T06:14:44.471 INFO:teuthology.orchestra.run.smithi176.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-24T06:14:44.471 INFO:teuthology.orchestra.run.smithi176.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-24T06:14:44.471 INFO:teuthology.orchestra.run.smithi176.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-24T06:14:44.471 INFO:teuthology.orchestra.run.smithi176.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-24T06:14:44.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.472 DEBUG:teuthology.orchestra.run.smithi176:> (cd / && exec bash -c ' 2023-11-24T06:14:44.472 DEBUG:teuthology.orchestra.run.smithi176:> set -e 2023-11-24T06:14:44.472 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-24T06:14:44.472 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-24T06:14:44.472 DEBUG:teuthology.orchestra.run.smithi176:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-24T06:14:44.473 DEBUG:teuthology.orchestra.run.smithi176:> ') 2023-11-24T06:14:44.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.587 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:14:44.604 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:14:44.604 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:44.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.604 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link set brx.0 up 2023-11-24T06:14:44.671 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:44.673 DEBUG:teuthology.orchestra.run.smithi176:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:44.729 INFO:teuthology.orchestra.run.smithi176.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-11-24T06:14:44.729 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-24T06:14:44.729 DEBUG:teuthology.orchestra.run.smithi176:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:44.786 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-11-24T06:14:44.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.787 DEBUG:teuthology.orchestra.run.smithi176:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:44.873 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:44.873 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:44.873 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:44.882 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:44.883 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:44.883 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:44.883 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:44.883 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:invalid new device string format 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:3300,172.21.15.176:3300,172.21.15.176:3301" 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: switching to using v1 address with old syntax 2023-11-24T06:14:44.957 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: resolved to: "172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790" 2023-11-24T06:14:44.958 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.106:6789,172.21.15.176:6789,172.21.15.176:6790:/ 2023-11-24T06:14:44.958 INFO:teuthology.orchestra.run.smithi176.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=2a42eb6f-5aad-4f8e-8067-d72b439cd81f" will pass to kernel 2023-11-24T06:14:44.959 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-24T06:14:44.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.959 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:44.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:44.985 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-24T06:14:45.057 INFO:teuthology.orchestra.run.smithi176.stdout:client5277 2023-11-24T06:14:45.058 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:45.058 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:45.115 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-11-24T06:14:45.247 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.245+0000 7f8b3fa71700 1 Processor -- start 2023-11-24T06:14:45.248 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.245+0000 7f8b3fa71700 1 -- start start 2023-11-24T06:14:45.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f8b38144600 0x7f8b380b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806f480 0x7f8b3806c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b3806e830 0x7f8b3806eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3806aff0 con 0x7f8b3806e830 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b3806f1e0 con 0x7f8b38144600 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3fa71700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b3806b200 con 0x7f8b3806f480 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b3806e830 0x7f8b3806eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b3806e830 0x7f8b3806eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59888/0 (socket says 172.21.15.106:59888) 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4286798887 learned_addr learned my addr 172.21.15.106:0/4286798887 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3d80d700 1 --2- 172.21.15.106:0/4286798887 >> v2:172.21.15.176:3300/0 conn(0x7f8b38144600 0x7f8b380b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3d00c700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806f480 0x7f8b3806c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4286798887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806f480 msgr2=0x7f8b3806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806f480 0x7f8b3806c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4286798887 >> v2:172.21.15.176:3300/0 conn(0x7f8b38144600 msgr2=0x7f8b380b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4286798887 >> v2:172.21.15.176:3300/0 conn(0x7f8b38144600 0x7f8b380b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4286798887 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3806b4e0 con 0x7f8b3806e830 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b3806e830 0x7f8b3806eca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b380734a0 tx=0x7f8b3000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d80cea5f101358 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.246+0000 7f8b3c80b700 1 -- 172.21.15.106:0/4286798887 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30010070 con 0x7f8b3806e830 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3c80b700 1 -- 172.21.15.106:0/4286798887 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3000dce0 con 0x7f8b3806e830 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3c80b700 1 -- 172.21.15.106:0/4286798887 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3000b310 con 0x7f8b3806e830 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4286798887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b3806e830 msgr2=0x7f8b3806eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b3806e830 0x7f8b3806eca0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8b380734a0 tx=0x7f8b3000d430 comp rx=0 tx=0).stop 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4286798887 shutdown_connections 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b3806e830 0x7f8b3806eca0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4286798887 >> v2:172.21.15.176:3300/0 conn(0x7f8b38144600 0x7f8b380b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4286798887 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806f480 0x7f8b3806c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4286798887 >> 172.21.15.106:0/4286798887 conn(0x7f8b380d0b40 msgr2=0x7f8b380d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4286798887 shutdown_connections 2023-11-24T06:14:45.253 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.247+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4286798887 wait complete. 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.248+0000 7f8b3fa71700 1 Processor -- start 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.248+0000 7f8b3fa71700 1 -- start start 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806e830 0x7f8b38132fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3806f480 0x7f8b380aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38133510 con 0x7f8b38144600 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b380a9690 con 0x7f8b3806f480 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3fa71700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b38133740 con 0x7f8b3806e830 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.256 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59894/0 (socket says 172.21.15.106:59894) 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4000472137 learned_addr learned my addr 172.21.15.106:0/4000472137 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3d00c700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3806f480 0x7f8b380aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3d80d700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806e830 0x7f8b38132fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806e830 msgr2=0x7f8b38132fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806e830 0x7f8b38132fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3806f480 msgr2=0x7f8b380aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3806f480 0x7f8b380aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.249+0000 7f8b3e00e700 1 -- 172.21.15.106:0/4000472137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3000bd40 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b3e00e700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b38072c70 tx=0x7f8b30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30009a10 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b30009b70 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b38133a20 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b30004040 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.250+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b381ef860 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.251+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b38133f40 con 0x7f8b38144600 2023-11-24T06:14:45.258 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.251+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8b300041a0 con 0x7f8b38144600 2023-11-24T06:14:45.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.252+0000 7f8b2e7fc700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 0x7f8b1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:45.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.252+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b3008d010 con 0x7f8b38144600 2023-11-24T06:14:45.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.252+0000 7f8b3d80d700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 0x7f8b1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:45.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.252+0000 7f8b3d80d700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 0x7f8b1c06d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b380690c0 tx=0x7f8b34008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:45.259 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.256+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8b38133f40 con 0x7f8b38144600 2023-11-24T06:14:45.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.490+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8b380a9460 con 0x7f8b38144600 2023-11-24T06:14:45.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.921+0000 7f8b2e7fc700 1 -- 172.21.15.106:0/4000472137 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8b380a9460 con 0x7f8b38144600 2023-11-24T06:14:45.926 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.923+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 msgr2=0x7f8b1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.923+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 0x7f8b1c06d390 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8b380690c0 tx=0x7f8b34008040 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.923+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 msgr2=0x7f8b380ae410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.923+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8b38072c70 tx=0x7f8b30004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 shutdown_connections 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8b1c06aed0 0x7f8b1c06d390 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b38144600 0x7f8b380ae410 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8b3806e830 0x7f8b38132fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 --2- 172.21.15.106:0/4000472137 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8b3806f480 0x7f8b380aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:45.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 >> 172.21.15.106:0/4000472137 conn(0x7f8b380d0b40 msgr2=0x7f8b380b3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 shutdown_connections 2023-11-24T06:14:45.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:45.924+0000 7f8b3fa71700 1 -- 172.21.15.106:0/4000472137 wait complete. 2023-11-24T06:14:45.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-11-24T06:14:46.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.058+0000 7fc6541df700 1 Processor -- start 2023-11-24T06:14:46.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 -- start start 2023-11-24T06:14:46.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc64c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc64c0af4d0 0x7fc64c0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc64c0ae430 con 0x7fc64c06c000 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc64c0af0b0 con 0x7fc64c0af4d0 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc6541df700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0b05a0 con 0x7fc64c15e080 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.059+0000 7fc65277c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc64c06c000 0x7fc64c073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40164/0 (socket says 172.21.15.106:40164) 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65277c700 1 -- 172.21.15.106:0/818311216 learned_addr learned my addr 172.21.15.106:0/818311216 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 --2- 172.21.15.106:0/818311216 >> v2:172.21.15.176:3300/0 conn(0x7fc64c0af4d0 0x7fc64c0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc651f7b700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc64c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1869983794 0 0) 0x7fc64c0ae430 con 0x7fc64c06c000 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6380035b0 con 0x7fc64c06c000 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786066829 0 0) 0x7fc6380035b0 con 0x7fc64c06c000 2023-11-24T06:14:46.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 msgr2=0x7fc64c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc64c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 >> v2:172.21.15.176:3300/0 conn(0x7fc64c0af4d0 msgr2=0x7fc64c0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 --2- 172.21.15.106:0/818311216 >> v2:172.21.15.176:3300/0 conn(0x7fc64c0af4d0 0x7fc64c0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0ae710 con 0x7fc64c06c000 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fc6440019f0 con 0x7fc64c06c000 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 >> v1:172.21.15.106:6789/0 conn(0x7fc64c06c000 legacy=0x7fc64c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc638003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc638003fb0 0x7fc638004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638004d90 0x7fc638005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0af0b0 con 0x7fc638003fb0 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0b05a0 con 0x7fc638004d90 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63800ba10 con 0x7fc64c15e080 2023-11-24T06:14:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc638003fb0 0x7fc638004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc651f7b700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc638003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65277c700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638004d90 0x7fc638005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 -- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 msgr2=0x7fc638003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c15e080 0x7fc638003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 -- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638004d90 msgr2=0x7fc638005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638004d90 0x7fc638005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.060+0000 7fc65177a700 1 -- 172.21.15.106:0/818311216 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380035b0 con 0x7fc638003fb0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc65177a700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc638003fb0 0x7fc638004850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc648009b30 tx=0x7fc638005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365be7b5be23d7ab server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800e6c0 con 0x7fc638003fb0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800e820 con 0x7fc638003fb0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc650f79700 1 -- 172.21.15.106:0/818311216 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800eb90 con 0x7fc638003fb0 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 -- 172.21.15.106:0/818311216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc638003fb0 msgr2=0x7fc638004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 --2- 172.21.15.106:0/818311216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc638003fb0 0x7fc638004850 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc648009b30 tx=0x7fc638005880 comp rx=0 tx=0).stop 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc65277c700 1 -- 172.21.15.106:0/818311216 reap_dead start 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 -- 172.21.15.106:0/818311216 shutdown_connections 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 -- 172.21.15.106:0/818311216 >> 172.21.15.106:0/818311216 conn(0x7fc64c071b90 msgr2=0x7fc64c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 -- 172.21.15.106:0/818311216 shutdown_connections 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.061+0000 7fc6541df700 1 -- 172.21.15.106:0/818311216 wait complete. 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.063+0000 7fc6541df700 1 Processor -- start 2023-11-24T06:14:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.063+0000 7fc6541df700 1 -- start start 2023-11-24T06:14:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638003fb0 0x7fc64c149850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c0cd620 0x7fc64c1f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c06f6a0 con 0x7fc64c06ecb0 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cdaa0 con 0x7fc638003fb0 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc64c0cdd50 con 0x7fc64c0cd620 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59914/0 (socket says 172.21.15.106:59914) 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 -- 172.21.15.106:0/3147000306 learned_addr learned my addr 172.21.15.106:0/3147000306 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc651f7b700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638003fb0 0x7fc64c149850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65177a700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c0cd620 0x7fc64c1f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 -- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c0cd620 msgr2=0x7fc64c1f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c0cd620 0x7fc64c1f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 -- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638003fb0 msgr2=0x7fc64c149850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638003fb0 0x7fc64c149850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 -- 172.21.15.106:0/3147000306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c0ce030 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc65277c700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc638003a00 tx=0x7fc64400a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64400ad60 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6440133f0 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0ce310 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc644013780 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.064+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc64c0ce8d0 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.065+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc64c0cea90 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.066+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc6440138e0 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.066+0000 7fc6427fc700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 0x7fc63006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.066+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc644089d70 con 0x7fc64c06ecb0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.066+0000 7fc651f7b700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 0x7fc63006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.066+0000 7fc651f7b700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 0x7fc63006d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009b00 tx=0x7fc63c009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.071+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc644054e20 con 0x7fc64c06ecb0 2023-11-24T06:14:46.290 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.287+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc64c0aecd0 con 0x7fc63006aed0 2023-11-24T06:14:46.291 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.289+0000 7fc6427fc700 1 -- 172.21.15.106:0/3147000306 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc63c019070 con 0x7fc63006aed0 2023-11-24T06:14:46.291 INFO:teuthology.orchestra.run.smithi106.stdout:[ 2023-11-24T06:14:46.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:46.292 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephfs" 2023-11-24T06:14:46.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:46.292 INFO:teuthology.orchestra.run.smithi106.stdout:] 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 msgr2=0x7fc63006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 0x7fc63006d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc63c009b00 tx=0x7fc63c009210 comp rx=0 tx=0).stop 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 msgr2=0x7fc64c06f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc638003a00 tx=0x7fc64400a5f0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 shutdown_connections 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc63006aed0 0x7fc63006d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc64c06ecb0 0x7fc64c06f160 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc638003fb0 0x7fc64c149850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.294 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 --2- 172.21.15.106:0/3147000306 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc64c0cd620 0x7fc64c1f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 >> 172.21.15.106:0/3147000306 conn(0x7fc64c071b90 msgr2=0x7fc64c0b5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 shutdown_connections 2023-11-24T06:14:46.295 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.291+0000 7fc6541df700 1 -- 172.21.15.106:0/3147000306 wait complete. 2023-11-24T06:14:46.305 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-24T06:14:46.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.427+0000 7f893ea6d700 1 Processor -- start 2023-11-24T06:14:46.430 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.427+0000 7f893ea6d700 1 -- start start 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893ea6d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f89380cf610 0x7f89380add40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893ea6d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893806b080 con 0x7f8938073f90 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893ea6d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f893815c290 con 0x7f893815f9e0 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893ea6d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89380cf9f0 con 0x7f89380cf610 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893d00a700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8938073f90 0x7f893806b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40184/0 (socket says 172.21.15.106:40184) 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893d00a700 1 -- 172.21.15.106:0/2165546224 learned_addr learned my addr 172.21.15.106:0/2165546224 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893c809700 1 --2- 172.21.15.106:0/2165546224 >> v2:172.21.15.176:3300/0 conn(0x7f89380cf610 0x7f89380add40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f89377fe700 1 -- 172.21.15.106:0/2165546224 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3868211911 0 0) 0x7f893806b080 con 0x7f8938073f90 2023-11-24T06:14:46.432 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f89377fe700 1 -- 172.21.15.106:0/2165546224 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89280035b0 con 0x7f8938073f90 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893c809700 1 -- 172.21.15.106:0/2165546224 >> v1:172.21.15.176:6789/0 conn(0x7f893815f9e0 legacy=0x7f89380b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893c809700 1 -- 172.21.15.106:0/2165546224 >> v1:172.21.15.106:6789/0 conn(0x7f8938073f90 legacy=0x7f893806b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893c809700 1 -- 172.21.15.106:0/2165546224 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893815ff80 con 0x7f89380cf610 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.428+0000 7f893c809700 1 --2- 172.21.15.106:0/2165546224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89380add40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19e292fc6ce3b42 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f89377fe700 1 -- 172.21.15.106:0/2165546224 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011830 con 0x7f89380cf610 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f89377fe700 1 -- 172.21.15.106:0/2165546224 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c011990 con 0x7f89380cf610 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f89377fe700 1 -- 172.21.15.106:0/2165546224 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c011d00 con 0x7f89380cf610 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 -- 172.21.15.106:0/2165546224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 msgr2=0x7f89380add40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 --2- 172.21.15.106:0/2165546224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89380add40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f892c009870 tx=0x7f892c009b80 comp rx=0 tx=0).stop 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 -- 172.21.15.106:0/2165546224 shutdown_connections 2023-11-24T06:14:46.433 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 --2- 172.21.15.106:0/2165546224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89380add40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 -- 172.21.15.106:0/2165546224 >> 172.21.15.106:0/2165546224 conn(0x7f89380d0bf0 msgr2=0x7f89380d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 -- 172.21.15.106:0/2165546224 shutdown_connections 2023-11-24T06:14:46.434 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.429+0000 7f893ea6d700 1 -- 172.21.15.106:0/2165546224 wait complete. 2023-11-24T06:14:46.436 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.430+0000 7f893ea6d700 1 Processor -- start 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.430+0000 7f893ea6d700 1 -- start start 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89381f1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f893815f9e0 0x7f89381f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89381f2210 con 0x7f8938073f90 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893809aa00 con 0x7f89380cf610 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893ea6d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89380c6940 con 0x7f893815f9e0 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893c809700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893c809700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59924/0 (socket says 172.21.15.106:59924) 2023-11-24T06:14:46.437 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.431+0000 7f893c809700 1 -- 172.21.15.106:0/3822790768 learned_addr learned my addr 172.21.15.106:0/3822790768 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893d00a700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f893815f9e0 0x7f89381f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f8937fff700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89381f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 -- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f893815f9e0 msgr2=0x7f89381f1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f893815f9e0 0x7f89381f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 -- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 msgr2=0x7f89381f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89381f1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 -- 172.21.15.106:0/3822790768 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f892c0094a0 con 0x7f8938073f90 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f8937fff700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89381f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893c809700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f892c0090b0 tx=0x7f892c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c01aa90 con 0x7f8938073f90 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892c01abf0 con 0x7f8938073f90 2023-11-24T06:14:46.438 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89380c6c20 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892c0243f0 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.432+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f893809ac50 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.433+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f893809afc0 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.433+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f892c024550 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.434+0000 7f89357fa700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 0x7f891c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.434+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f892c08ad30 con 0x7f8938073f90 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.434+0000 7f8937fff700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 0x7f891c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.434+0000 7f8937fff700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 0x7f891c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89380cec30 tx=0x7f8924009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.441 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.438+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f892c055f90 con 0x7f8938073f90 2023-11-24T06:14:46.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.627+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f89380c7140 con 0x7f8938073f90 2023-11-24T06:14:46.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.628+0000 7f89357fa700 1 -- 172.21.15.106:0/3822790768 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f892c015070 con 0x7f8938073f90 2023-11-24T06:14:46.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.629+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 msgr2=0x7f891c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.629+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 0x7f891c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89380cec30 tx=0x7f8924009040 comp rx=0 tx=0).stop 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 msgr2=0x7f8938148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f892c0090b0 tx=0x7f892c004750 comp rx=0 tx=0).stop 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 shutdown_connections 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f891c06aed0 0x7f891c06d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f893815f9e0 0x7f89381f1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8938073f90 0x7f8938148530 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 --2- 172.21.15.106:0/3822790768 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f89380cf610 0x7f89381f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 >> 172.21.15.106:0/3822790768 conn(0x7f89380d0bf0 msgr2=0x7f89380b3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 shutdown_connections 2023-11-24T06:14:46.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.630+0000 7f893ea6d700 1 -- 172.21.15.106:0/3822790768 wait complete. 2023-11-24T06:14:46.644 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-24T06:14:46.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:46.691 DEBUG:teuthology.orchestra.run.smithi176:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-24T06:14:46.736 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-24T06:14:46.737 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:46.737 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:46.754 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:46.754 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:46.811 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:46.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.969+0000 7f6c13ea2700 1 Processor -- start 2023-11-24T06:14:46.972 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 -- start start 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c0c152cc0 0x7f6c0c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 0x7f6c0c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0c15c4b0 con 0x7f6c0c0b49a0 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c0c15c790 con 0x7f6c0c152cc0 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c13ea2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c15ca70 con 0x7f6c0c0d0630 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.970+0000 7f6c11c3e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c0c152cc0 0x7f6c0c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c0c152cc0 0x7f6c0c06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59932/0 (socket says 172.21.15.106:59932) 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 -- 172.21.15.106:0/3642924779 learned_addr learned my addr 172.21.15.106:0/3642924779 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c1243f700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 0x7f6c0c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 -- 172.21.15.106:0/3642924779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 msgr2=0x7f6c0c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.975 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 0x7f6c0c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 -- 172.21.15.106:0/3642924779 >> v1:172.21.15.176:6789/0 conn(0x7f6c0c0b49a0 legacy=0x7f6c0c0cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 -- 172.21.15.106:0/3642924779 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c0c15cd50 con 0x7f6c0c152cc0 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c1243f700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 0x7f6c0c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c06c000 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0098f0 tx=0x7f6bfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de62f0c969d42b59 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c10c3c700 1 -- 172.21.15.106:0/3642924779 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00b8a0 con 0x7f6c0c152cc0 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c10c3c700 1 -- 172.21.15.106:0/3642924779 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc00ba00 con 0x7f6c0c152cc0 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.971+0000 7f6c10c3c700 1 -- 172.21.15.106:0/3642924779 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc00bd90 con 0x7f6c0c152cc0 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3642924779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c152cc0 msgr2=0x7f6c0c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c06c000 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0098f0 tx=0x7f6bfc009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3642924779 shutdown_connections 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0d0630 0x7f6c0c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.976 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3642924779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c06c000 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3642924779 >> 172.21.15.106:0/3642924779 conn(0x7f6c0c071b90 msgr2=0x7f6c0c071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:46.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3642924779 shutdown_connections 2023-11-24T06:14:46.977 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.972+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3642924779 wait complete. 2023-11-24T06:14:46.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.973+0000 7f6c13ea2700 1 Processor -- start 2023-11-24T06:14:46.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.973+0000 7f6c13ea2700 1 -- start start 2023-11-24T06:14:46.979 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 0x7f6c0c147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c0b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c147bd0 con 0x7f6c0c0d0630 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c156cd0 con 0x7f6c0c152cc0 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0c0cfec0 con 0x7f6c0c0b49a0 2023-11-24T06:14:46.980 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59940/0 (socket says 172.21.15.106:59940) 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 -- 172.21.15.106:0/3940489222 learned_addr learned my addr 172.21.15.106:0/3940489222 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1243f700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c0b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 0x7f6c0c147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 -- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 msgr2=0x7f6c0c147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 0x7f6c0c147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.981 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 -- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 msgr2=0x7f6c0c0b1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c0b1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 -- 172.21.15.106:0/3940489222 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc009550 con 0x7f6c0c0d0630 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1243f700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 0x7f6c0c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c1143d700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c4e0 tx=0x7f6c0800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080052d0 con 0x7f6c0c0d0630 2023-11-24T06:14:46.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c08005430 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c080038c0 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0c14a5a0 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.974+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c0c14ab60 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.975+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c0c156fb0 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.976+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c08003a20 con 0x7f6c0c0d0630 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.976+0000 7f6c027fc700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 0x7f6bf006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:46.983 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.976+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c08088b50 con 0x7f6c0c0d0630 2023-11-24T06:14:46.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.976+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 0x7f6bf006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:46.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.977+0000 7f6c11c3e700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 0x7f6bf006d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc014040 tx=0x7f6bfc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:46.984 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:46.981+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c08053b60 con 0x7f6c0c0d0630 2023-11-24T06:14:47.173 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.171+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c0c0753f0 con 0x7f6c0c0d0630 2023-11-24T06:14:47.174 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.172+0000 7f6c027fc700 1 -- 172.21.15.106:0/3940489222 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f6c08017090 con 0x7f6c0c0d0630 2023-11-24T06:14:47.175 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:47.175 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 msgr2=0x7f6bf006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 0x7f6bf006d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc014040 tx=0x7f6bfc008030 comp rx=0 tx=0).stop 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 msgr2=0x7f6c0c159070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.177 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800c4e0 tx=0x7f6c0800c8a0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 shutdown_connections 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6bf006aed0 0x7f6bf006d390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c0c152cc0 0x7f6c0c0b1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c0c0b49a0 0x7f6c0c147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 --2- 172.21.15.106:0/3940489222 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c0c0d0630 0x7f6c0c159070 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.178 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 >> 172.21.15.106:0/3940489222 conn(0x7f6c0c071b90 msgr2=0x7f6c0c15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 shutdown_connections 2023-11-24T06:14:47.179 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.174+0000 7f6c13ea2700 1 -- 172.21.15.106:0/3940489222 wait complete. 2023-11-24T06:14:47.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:33.757193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:34.919394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:47.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:47.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.310+0000 7f6c330b4700 1 Processor -- start 2023-11-24T06:14:47.313 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.310+0000 7f6c330b4700 1 -- start start 2023-11-24T06:14:47.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c330b4700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f6c2c0ad870 0x7f6c2c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c330b4700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c06e400 con 0x7f6c2c15e290 2023-11-24T06:14:47.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c330b4700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c2c06e630 con 0x7f6c2c0aedc0 2023-11-24T06:14:47.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c330b4700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c2c06fde0 con 0x7f6c2c0ad870 2023-11-24T06:14:47.317 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2bfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c2c15e290 0x7f6c2c06f6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40208/0 (socket says 172.21.15.106:40208) 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2bfff700 1 -- 172.21.15.106:0/3761798528 learned_addr learned my addr 172.21.15.106:0/3761798528 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184385723 0 0) 0x7f6c2c06e400 con 0x7f6c2c15e290 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c1c0035b0 con 0x7f6c2c15e290 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c31651700 1 --2- 172.21.15.106:0/3761798528 >> v2:172.21.15.176:3300/0 conn(0x7f6c2c0ad870 0x7f6c2c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2350069436 0 0) 0x7f6c1c0035b0 con 0x7f6c2c15e290 2023-11-24T06:14:47.318 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 >> v2:172.21.15.176:3300/0 conn(0x7f6c2c0ad870 msgr2=0x7f6c2c0ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 --2- 172.21.15.106:0/3761798528 >> v2:172.21.15.176:3300/0 conn(0x7f6c2c0ad870 0x7f6c2c0ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 >> v1:172.21.15.176:6789/0 conn(0x7f6c2c0aedc0 legacy=0x7f6c2c0af1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c06e910 con 0x7f6c2c15e290 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f6c18001670 con 0x7f6c2c15e290 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 >> v1:172.21.15.106:6789/0 conn(0x7f6c2c15e290 legacy=0x7f6c2c06f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.319 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c1c003a00 0x7f6c1c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 0x7f6c1c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c005210 0x7f6c1c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c06fde0 con 0x7f6c1c004850 2023-11-24T06:14:47.320 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c00c1b0 con 0x7f6c1c003a00 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.311+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c00c370 con 0x7f6c1c005210 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 0x7f6c1c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c30e50700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c1c003a00 0x7f6c1c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c31651700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c005210 0x7f6c1c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 -- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c005210 msgr2=0x7f6c1c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.321 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c005210 0x7f6c1c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 -- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c1c003a00 msgr2=0x7f6c1c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c1c003a00 0x7f6c1c003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c31651700 1 -- 172.21.15.106:0/3761798528 reap_dead start 2023-11-24T06:14:47.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 -- 172.21.15.106:0/3761798528 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0035b0 con 0x7f6c1c004850 2023-11-24T06:14:47.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 0x7f6c1c004cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c240 tx=0x7f6c1c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ad13f2893d8798 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18007c10 con 0x7f6c1c004850 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1800cd60 con 0x7f6c1c004850 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.312+0000 7f6c2b7fe700 1 -- 172.21.15.106:0/3761798528 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18005ba0 con 0x7f6c1c004850 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 -- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 msgr2=0x7f6c1c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 0x7f6c1c004cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800c240 tx=0x7f6c1c005880 comp rx=0 tx=0).stop 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 -- 172.21.15.106:0/3761798528 shutdown_connections 2023-11-24T06:14:47.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 --2- 172.21.15.106:0/3761798528 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c1c004850 0x7f6c1c004cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 -- 172.21.15.106:0/3761798528 >> 172.21.15.106:0/3761798528 conn(0x7f6c2c0b2050 msgr2=0x7f6c2c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 -- 172.21.15.106:0/3761798528 shutdown_connections 2023-11-24T06:14:47.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.313+0000 7f6c330b4700 1 -- 172.21.15.106:0/3761798528 wait complete. 2023-11-24T06:14:47.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.314+0000 7f6c330b4700 1 Processor -- start 2023-11-24T06:14:47.324 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.314+0000 7f6c330b4700 1 -- start start 2023-11-24T06:14:47.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c004850 0x7f6c2c142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c2c15c610 0x7f6c2c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.328 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c150b50 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c15b1e0 con 0x7f6c2c15c610 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c330b4700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c15d3c0 con 0x7f6c1c004850 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59958/0 (socket says 172.21.15.106:59958) 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 -- 172.21.15.106:0/1858481724 learned_addr learned my addr 172.21.15.106:0/1858481724 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c31651700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c2c15c610 0x7f6c2c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c30e50700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c004850 0x7f6c2c142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 -- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c004850 msgr2=0x7f6c2c142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c004850 0x7f6c2c142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 -- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c2c15c610 msgr2=0x7f6c2c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.329 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c2c15c610 0x7f6c2c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 -- 172.21.15.106:0/1858481724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c15d6a0 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c2bfff700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6c180018d0 tx=0x7f6c18001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800ced0 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.315+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18001640 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.316+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c15d980 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.316+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c180072d0 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.316+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c15aed0 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.317+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c2c068d90 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.317+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c18007430 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.317+0000 7f6c297fa700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 0x7f6c1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.318+0000 7f6c30e50700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 0x7f6c1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.318+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c1808a640 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.318+0000 7f6c30e50700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 0x7f6c1006d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c064e10 tx=0x7f6c20009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.322+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c18055780 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.514+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c2c150d00 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.515+0000 7f6c297fa700 1 -- 172.21.15.106:0/1858481724 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c2c150d00 con 0x7f6c2c15a2d0 2023-11-24T06:14:47.517 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:47.519 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 msgr2=0x7f6c1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 0x7f6c1006d390 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c064e10 tx=0x7f6c20009040 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 msgr2=0x7f6c2c15a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6c180018d0 tx=0x7f6c18001a00 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 shutdown_connections 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f6c1006aed0 0x7f6c1006d390 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f6c2c15c610 0x7f6c2c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f6c1c004850 0x7f6c2c142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 --2- 172.21.15.106:0/1858481724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c2c15a2d0 0x7f6c2c15a990 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 >> 172.21.15.106:0/1858481724 conn(0x7f6c2c0b2050 msgr2=0x7f6c2c0add20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.520 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 shutdown_connections 2023-11-24T06:14:47.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.517+0000 7f6c330b4700 1 -- 172.21.15.106:0/1858481724 wait complete. 2023-11-24T06:14:47.531 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:47.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.652+0000 7f4c324cf700 1 Processor -- start 2023-11-24T06:14:47.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.652+0000 7f4c324cf700 1 -- start start 2023-11-24T06:14:47.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f4c2c15e160 0x7f4c2c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c2c0744d0 0x7f4c2c06d930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b4500 con 0x7f4c2c0744d0 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2c074960 con 0x7f4c2c15e160 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c324cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c0b3c60 con 0x7f4c2c0afc90 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c2c0744d0 0x7f4c2c06d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4c2c0744d0 0x7f4c2c06d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59968/0 (socket says 172.21.15.106:59968) 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2570257872 learned_addr learned my addr 172.21.15.106:0/2570257872 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2570257872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 msgr2=0x7f4c2c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2570257872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2570257872 >> v2:172.21.15.176:3300/0 conn(0x7f4c2c15e160 msgr2=0x7f4c2c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:47.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2570257872 >> v2:172.21.15.176:3300/0 conn(0x7f4c2c15e160 0x7f4c2c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2570257872 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c0b58c0 con 0x7f4c2c0744d0 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.653+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2570257872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c06d930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c09efa0 tx=0x7f4c2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0cb5edbac9388d server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c2affd700 1 -- 172.21.15.106:0/2570257872 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400e070 con 0x7f4c2c0744d0 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c2affd700 1 -- 172.21.15.106:0/2570257872 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2400b9c0 con 0x7f4c2c0744d0 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c2affd700 1 -- 172.21.15.106:0/2570257872 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2400bd70 con 0x7f4c2c0744d0 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 -- 172.21.15.106:0/2570257872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c0744d0 msgr2=0x7f4c2c06d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2570257872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c06d930 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c09efa0 tx=0x7f4c2400b330 comp rx=0 tx=0).stop 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 -- 172.21.15.106:0/2570257872 shutdown_connections 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2570257872 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c06d930 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2570257872 >> v2:172.21.15.176:3300/0 conn(0x7f4c2c15e160 0x7f4c2c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2570257872 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 -- 172.21.15.106:0/2570257872 >> 172.21.15.106:0/2570257872 conn(0x7f4c2c0d0bf0 msgr2=0x7f4c2c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 -- 172.21.15.106:0/2570257872 shutdown_connections 2023-11-24T06:14:47.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.654+0000 7f4c324cf700 1 -- 172.21.15.106:0/2570257872 wait complete. 2023-11-24T06:14:47.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.655+0000 7f4c324cf700 1 Processor -- start 2023-11-24T06:14:47.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 -- start start 2023-11-24T06:14:47.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c0b1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.662 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c14ed30 con 0x7f4c2c15e160 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c14e400 con 0x7f4c2c0744d0 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c324cf700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2c14e6e0 con 0x7f4c2c0afc90 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c30a6c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c30a6c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59974/0 (socket says 172.21.15.106:59974) 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.656+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2020411135 learned_addr learned my addr 172.21.15.106:0/2020411135 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c2bfff700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c2b7fe700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c0b1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 msgr2=0x7f4c2c0b1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c0b1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 msgr2=0x7f4c2c150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.663 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 -- 172.21.15.106:0/2020411135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24009b30 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c2bfff700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c30a6c700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400b370 tx=0x7f4c24004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c24004390 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c240044f0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2c14e9c0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c240048a0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.657+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c2c14e0b0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.658+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2c068fb0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.658+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c2401c440 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.659+0000 7f4c28ff9700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 0x7f4c1806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.659+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c2408acd0 con 0x7f4c2c15e160 2023-11-24T06:14:47.664 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.659+0000 7f4c2bfff700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 0x7f4c1806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:47.665 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.659+0000 7f4c2bfff700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 0x7f4c1806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006fd0 tx=0x7f4c20008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:47.666 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.663+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c24055e10 con 0x7f4c2c15e160 2023-11-24T06:14:47.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.854+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c2c06c140 con 0x7f4c2c15e160 2023-11-24T06:14:47.857 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.855+0000 7f4c28ff9700 1 -- 172.21.15.106:0/2020411135 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c240200a0 con 0x7f4c2c15e160 2023-11-24T06:14:47.858 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 msgr2=0x7f4c1806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 0x7f4c1806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006fd0 tx=0x7f4c20008040 comp rx=0 tx=0).stop 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 msgr2=0x7f4c2c14f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c2400b370 tx=0x7f4c24004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 shutdown_connections 2023-11-24T06:14:47.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4c1806aed0 0x7f4c1806d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4c2c15e160 0x7f4c2c14f1c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4c2c0744d0 0x7f4c2c150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 --2- 172.21.15.106:0/2020411135 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4c2c0afc90 0x7f4c2c0b1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 >> 172.21.15.106:0/2020411135 conn(0x7f4c2c0d0bf0 msgr2=0x7f4c2c15d730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 shutdown_connections 2023-11-24T06:14:47.861 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.857+0000 7f4c324cf700 1 -- 172.21.15.106:0/2020411135 wait complete. 2023-11-24T06:14:47.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:48.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.993+0000 7faeec075700 1 Processor -- start 2023-11-24T06:14:48.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.994+0000 7faeec075700 1 -- start start 2023-11-24T06:14:48.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.994+0000 7faeec075700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faee40cf110 0x7faee40cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.006 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faeec075700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40d0140 con 0x7faee40c6c30 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faeec075700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee40d03e0 con 0x7faee415bf50 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faeec075700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee415c330 con 0x7faee40cf110 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee9610700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faee40c6c30 0x7faee40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40240/0 (socket says 172.21.15.106:40240) 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee9610700 1 -- 172.21.15.106:0/4051946949 learned_addr learned my addr 172.21.15.106:0/4051946949 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faeea612700 1 --2- 172.21.15.106:0/4051946949 >> v2:172.21.15.176:3300/0 conn(0x7faee40cf110 0x7faee40cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2764245646 0 0) 0x7faee40d0140 con 0x7faee40c6c30 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faed00035b0 con 0x7faee40c6c30 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281787755 0 0) 0x7faed00035b0 con 0x7faee40c6c30 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 >> v2:172.21.15.176:3300/0 conn(0x7faee40cf110 msgr2=0x7faee40cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 --2- 172.21.15.106:0/4051946949 >> v2:172.21.15.176:3300/0 conn(0x7faee40cf110 0x7faee40cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 >> v1:172.21.15.176:6789/0 conn(0x7faee415bf50 legacy=0x7faee40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee40d06c0 con 0x7faee40c6c30 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7faee0001670 con 0x7faee40c6c30 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 >> v1:172.21.15.106:6789/0 conn(0x7faee40c6c30 legacy=0x7faee40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed0003a00 0x7faed0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faed0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed0005210 0x7faed000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee415c330 con 0x7faed0004850 2023-11-24T06:14:48.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed000c0b0 con 0x7faed0005210 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed000c270 con 0x7faed0003a00 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee9610700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faed0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faeea612700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed0005210 0x7faed000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.995+0000 7faee9e11700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed0003a00 0x7faed0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 -- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed0003a00 msgr2=0x7faed0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faed0003a00 0x7faed0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 -- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed0005210 msgr2=0x7faed000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faed0005210 0x7faed000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 -- 172.21.15.106:0/4051946949 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed00035b0 con 0x7faed0004850 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeea612700 1 -- 172.21.15.106:0/4051946949 reap_dead start 2023-11-24T06:14:48.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee9610700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faed0004cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faee000c240 tx=0x7faed0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d1baef3549f869 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0007c10 con 0x7faed0004850 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faee000cd60 con 0x7faed0004850 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faee8e0f700 1 -- 172.21.15.106:0/4051946949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faee0005ba0 con 0x7faed0004850 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeec075700 1 -- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 msgr2=0x7faed0004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeec075700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faed0004cd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7faee000c240 tx=0x7faed0005880 comp rx=0 tx=0).stop 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeec075700 1 -- 172.21.15.106:0/4051946949 shutdown_connections 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeec075700 1 --2- 172.21.15.106:0/4051946949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faed0004cd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.996+0000 7faeec075700 1 -- 172.21.15.106:0/4051946949 >> 172.21.15.106:0/4051946949 conn(0x7faee40b3780 msgr2=0x7faee40b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.997+0000 7faeec075700 1 -- 172.21.15.106:0/4051946949 shutdown_connections 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.997+0000 7faeec075700 1 -- 172.21.15.106:0/4051946949 wait complete. 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 Processor -- start 2023-11-24T06:14:48.010 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 -- start start 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faee415c470 0x7faee40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee414aa30 0x7faee414aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee414b400 con 0x7faed0004850 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.998+0000 7faeec075700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee41f3940 con 0x7faee414aa30 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeec075700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee415cbe0 con 0x7faee415c470 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:59990/0 (socket says 172.21.15.106:59990) 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 -- 172.21.15.106:0/1298515340 learned_addr learned my addr 172.21.15.106:0/1298515340 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9610700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faee415c470 0x7faee40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeea612700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee414aa30 0x7faee414aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 -- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faee415c470 msgr2=0x7faee40cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faee415c470 0x7faee40cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 -- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee414aa30 msgr2=0x7faee414aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee414aa30 0x7faee414aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 -- 172.21.15.106:0/1298515340 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee415c900 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faee9e11700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faed400f850 tx=0x7faed400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40052e0 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4005440 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee406baa0 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40038a0 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:47.999+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee406c060 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.000+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee406c1f0 con 0x7faed0004850 2023-11-24T06:14:48.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.000+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faed4003a00 con 0x7faed0004850 2023-11-24T06:14:48.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.001+0000 7faeda7fc700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 0x7faec806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.001+0000 7faee9610700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 0x7faec806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.001+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faed4089210 con 0x7faed0004850 2023-11-24T06:14:48.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.001+0000 7faee9610700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 0x7faec806d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faee0015040 tx=0x7faee0007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.005+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faed40542c0 con 0x7faed0004850 2023-11-24T06:14:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.194+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faee4068fb0 con 0x7faed0004850 2023-11-24T06:14:48.197 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.194+0000 7faeda7fc700 1 -- 172.21.15.106:0/1298515340 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7faed4003cb0 con 0x7faed0004850 2023-11-24T06:14:48.197 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:48.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 msgr2=0x7faec806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 0x7faec806d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7faee0015040 tx=0x7faee0007000 comp rx=0 tx=0).stop 2023-11-24T06:14:48.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 msgr2=0x7faee406c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.199 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7faed400f850 tx=0x7faed400fb60 comp rx=0 tx=0).stop 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 shutdown_connections 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faec806aed0 0x7faec806d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faee414aa30 0x7faee414aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faed0004850 0x7faee406c580 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 --2- 172.21.15.106:0/1298515340 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faee415c470 0x7faee40cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 >> 172.21.15.106:0/1298515340 conn(0x7faee40b3780 msgr2=0x7faee40cc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 shutdown_connections 2023-11-24T06:14:48.200 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.196+0000 7faeec075700 1 -- 172.21.15.106:0/1298515340 wait complete. 2023-11-24T06:14:48.211 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:48.333 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.331+0000 7f3d776e8700 1 Processor -- start 2023-11-24T06:14:48.334 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.331+0000 7f3d776e8700 1 -- start start 2023-11-24T06:14:48.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d776e8700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 0x7f3d700b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d776e8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d7006c710 0x7f3d700afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d776e8700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d700ae430 con 0x7f3d700af4d0 2023-11-24T06:14:48.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d776e8700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d700af0b0 con 0x7f3d7006c710 2023-11-24T06:14:48.336 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d776e8700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d700b05a0 con 0x7f3d7015e080 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d7006c710 0x7f3d700afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3d7006c710 0x7f3d700afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60002/0 (socket says 172.21.15.106:60002) 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 -- 172.21.15.106:0/2634624440 learned_addr learned my addr 172.21.15.106:0/2634624440 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75484700 1 --2- 172.21.15.106:0/2634624440 >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 0x7f3d700b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 -- 172.21.15.106:0/2634624440 >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 msgr2=0x7f3d700b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 --2- 172.21.15.106:0/2634624440 >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 0x7f3d700b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 -- 172.21.15.106:0/2634624440 >> v1:172.21.15.176:6789/0 conn(0x7f3d700af4d0 legacy=0x7f3d7006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 -- 172.21.15.106:0/2634624440 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d700ae710 con 0x7f3d7006c710 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75484700 1 --2- 172.21.15.106:0/2634624440 >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 0x7f3d700b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:48.337 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d75c85700 1 --2- 172.21.15.106:0/2634624440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7006c710 0x7f3d700afb90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d70072a90 tx=0x7f3d6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c044f472dd29ab0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.332+0000 7f3d67fff700 1 -- 172.21.15.106:0/2634624440 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6800e070 con 0x7f3d7006c710 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d67fff700 1 -- 172.21.15.106:0/2634624440 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d68003a20 con 0x7f3d7006c710 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d67fff700 1 -- 172.21.15.106:0/2634624440 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68003dd0 con 0x7f3d7006c710 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 -- 172.21.15.106:0/2634624440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7006c710 msgr2=0x7f3d700afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 --2- 172.21.15.106:0/2634624440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7006c710 0x7f3d700afb90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f3d70072a90 tx=0x7f3d6800b330 comp rx=0 tx=0).stop 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 -- 172.21.15.106:0/2634624440 shutdown_connections 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 --2- 172.21.15.106:0/2634624440 >> v2:172.21.15.176:3300/0 conn(0x7f3d7015e080 0x7f3d700b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 --2- 172.21.15.106:0/2634624440 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7006c710 0x7f3d700afb90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 -- 172.21.15.106:0/2634624440 >> 172.21.15.106:0/2634624440 conn(0x7f3d70071b90 msgr2=0x7f3d70071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.338 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 -- 172.21.15.106:0/2634624440 shutdown_connections 2023-11-24T06:14:48.339 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.333+0000 7f3d776e8700 1 -- 172.21.15.106:0/2634624440 wait complete. 2023-11-24T06:14:48.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.334+0000 7f3d776e8700 1 Processor -- start 2023-11-24T06:14:48.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.334+0000 7f3d776e8700 1 -- start start 2023-11-24T06:14:48.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d7006c710 0x7f3d70155450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700af4d0 0x7f3d70159740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.341 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70156e60 con 0x7f3d7015e080 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7015a1c0 con 0x7f3d7006c710 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d776e8700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d70155dc0 con 0x7f3d700af4d0 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d75c85700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d75c85700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60008/0 (socket says 172.21.15.106:60008) 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d75c85700 1 -- 172.21.15.106:0/725631176 learned_addr learned my addr 172.21.15.106:0/725631176 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.335+0000 7f3d75484700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d7006c710 0x7f3d70155450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 -- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700af4d0 msgr2=0x7f3d70159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.342 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700af4d0 0x7f3d70159740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 -- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d7006c710 msgr2=0x7f3d70155450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d7006c710 0x7f3d70155450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 -- 172.21.15.106:0/725631176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d68009b30 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d75c85700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3d68004000 tx=0x7f3d68004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68004440 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d680092e0 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d701560a0 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d68004820 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.336+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d70156940 con 0x7f3d7015e080 2023-11-24T06:14:48.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.337+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d700753f0 con 0x7f3d7015e080 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.337+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3d68012430 con 0x7f3d7015e080 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.338+0000 7f3d65ffb700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 0x7f3d5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.338+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d6808aa70 con 0x7f3d7015e080 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.338+0000 7f3d75484700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 0x7f3d5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.338+0000 7f3d75484700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 0x7f3d5406d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c006fd0 tx=0x7f3d6c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.344 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.342+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3d68055bb0 con 0x7f3d7015e080 2023-11-24T06:14:48.552 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.549+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3d70156b60 con 0x7f3d7015e080 2023-11-24T06:14:48.553 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.550+0000 7f3d65ffb700 1 -- 172.21.15.106:0/725631176 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3d680591d0 con 0x7f3d7015e080 2023-11-24T06:14:48.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 msgr2=0x7f3d5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.556 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 0x7f3d5406d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c006fd0 tx=0x7f3d6c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:48.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 msgr2=0x7f3d70159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f3d68004000 tx=0x7f3d68004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 shutdown_connections 2023-11-24T06:14:48.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3d5406aed0 0x7f3d5406d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d7015e080 0x7f3d70159c80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3d7006c710 0x7f3d70155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 --2- 172.21.15.106:0/725631176 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3d700af4d0 0x7f3d70159740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 >> 172.21.15.106:0/725631176 conn(0x7f3d70071b90 msgr2=0x7f3d700b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 shutdown_connections 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.552+0000 7f3d776e8700 1 -- 172.21.15.106:0/725631176 wait complete. 2023-11-24T06:14:48.558 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:48.567 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-24T06:14:48.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:48.568 DEBUG:teuthology.orchestra.run.smithi106:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-11-24T06:14:48.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:14:48.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:48.618 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-24T06:14:48.635 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:48.635 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:48.656 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:48.656 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:48.718 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:48.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.836+0000 7f643ee3f700 1 Processor -- start 2023-11-24T06:14:48.839 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.836+0000 7f643ee3f700 1 -- start start 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643ee3f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 0x7f64380b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643ee3f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64380af4d0 0x7f64380afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643ee3f700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64380ae430 con 0x7f643806c000 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643ee3f700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64380af0b0 con 0x7f64380af4d0 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643ee3f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64380b05a0 con 0x7f643815e080 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64380af4d0 0x7f64380afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f64380af4d0 0x7f64380afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60014/0 (socket says 172.21.15.106:60014) 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 -- 172.21.15.106:0/827084296 learned_addr learned my addr 172.21.15.106:0/827084296 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643cbdb700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 0x7f64380b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 -- 172.21.15.106:0/827084296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 msgr2=0x7f64380b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 0x7f64380b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.842 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 -- 172.21.15.106:0/827084296 >> v1:172.21.15.176:6789/0 conn(0x7f643806c000 legacy=0x7f6438073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f6437fff700 1 -- 172.21.15.106:0/827084296 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380ae710 con 0x7f64380af4d0 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.837+0000 7f643cbdb700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 0x7f64380b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f6437fff700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f64380afb90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6424009920 tx=0x7f6424009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ce70d3656b703 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f64377fe700 1 -- 172.21.15.106:0/827084296 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424004230 con 0x7f64380af4d0 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f64377fe700 1 -- 172.21.15.106:0/827084296 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6424004390 con 0x7f64380af4d0 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f64377fe700 1 -- 172.21.15.106:0/827084296 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6424009e70 con 0x7f64380af4d0 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 -- 172.21.15.106:0/827084296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 msgr2=0x7f64380afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f64380afb90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6424009920 tx=0x7f6424009c30 comp rx=0 tx=0).stop 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 -- 172.21.15.106:0/827084296 shutdown_connections 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643815e080 0x7f64380b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.843 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 --2- 172.21.15.106:0/827084296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f64380afb90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 -- 172.21.15.106:0/827084296 >> 172.21.15.106:0/827084296 conn(0x7f6438071b90 msgr2=0x7f6438071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:48.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 -- 172.21.15.106:0/827084296 shutdown_connections 2023-11-24T06:14:48.844 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.838+0000 7f643ee3f700 1 -- 172.21.15.106:0/827084296 wait complete. 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 Processor -- start 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 -- start start 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806c000 0x7f64380cf060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815e080 0x7f64381525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64380cff90 con 0x7f64380af4d0 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f643815ef80 con 0x7f643815e080 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f643ee3f700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64380cf6f0 con 0x7f643806c000 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.840+0000 7f6437fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60020/0 (socket says 172.21.15.106:60020) 2023-11-24T06:14:48.847 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 -- 172.21.15.106:0/918908902 learned_addr learned my addr 172.21.15.106:0/918908902 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f643cbdb700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806c000 0x7f64380cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f643d3dc700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815e080 0x7f64381525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 -- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806c000 msgr2=0x7f64380cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806c000 0x7f64380cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 -- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815e080 msgr2=0x7f64381525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815e080 0x7f64381525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 -- 172.21.15.106:0/918908902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6424009550 con 0x7f64380af4d0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f6437fff700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6424009130 tx=0x7f6424004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400bd80 con 0x7f64380af4d0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642401f070 con 0x7f64380af4d0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642400bee0 con 0x7f64380af4d0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64380cf9d0 con 0x7f64380af4d0 2023-11-24T06:14:48.848 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.841+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643814ede0 con 0x7f64380af4d0 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.842+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64380753f0 con 0x7f64380af4d0 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.842+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6424021030 con 0x7f64380af4d0 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.843+0000 7f64357fa700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 0x7f641c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.843+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f642408ac20 con 0x7f64380af4d0 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.843+0000 7f643cbdb700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 0x7f641c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:48.849 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.843+0000 7f643cbdb700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 0x7f641c06d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f642c006fd0 tx=0x7f642c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:48.850 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:48.847+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6424055d60 con 0x7f64380af4d0 2023-11-24T06:14:49.045 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.042+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64380753f0 con 0x7f64380af4d0 2023-11-24T06:14:49.046 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.043+0000 7f64357fa700 1 -- 172.21.15.106:0/918908902 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f6424059380 con 0x7f64380af4d0 2023-11-24T06:14:49.047 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:49.047 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:49.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.045+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 msgr2=0x7f641c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.045+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 0x7f641c06d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f642c006fd0 tx=0x7f642c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.045+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 msgr2=0x7f6438145330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.049 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.045+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f6424009130 tx=0x7f6424004750 comp rx=0 tx=0).stop 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 shutdown_connections 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f641c06aed0 0x7f641c06d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f643815e080 0x7f64381525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f643806c000 0x7f64380cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 --2- 172.21.15.106:0/918908902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f64380af4d0 0x7f6438145330 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 >> 172.21.15.106:0/918908902 conn(0x7f6438071b90 msgr2=0x7f64380b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 shutdown_connections 2023-11-24T06:14:49.050 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.046+0000 7f643ee3f700 1 -- 172.21.15.106:0/918908902 wait complete. 2023-11-24T06:14:49.060 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:33.757193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:34.919394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:49.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:49.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.181+0000 7f2760ed6700 1 Processor -- start 2023-11-24T06:14:49.183 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.181+0000 7f2760ed6700 1 -- start start 2023-11-24T06:14:49.186 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2760ed6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f275c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2760ed6700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c0b3c60 con 0x7f275c0746a0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2760ed6700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c0b58c0 con 0x7f275c15e160 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2760ed6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0b4500 con 0x7f275c0b5da0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2759d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f275c0746a0 0x7f275c06d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40288/0 (socket says 172.21.15.106:40288) 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f2759d9b700 1 -- 172.21.15.106:0/2787161923 learned_addr learned my addr 172.21.15.106:0/2787161923 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035632153 0 0) 0x7f275c0b3c60 con 0x7f275c0746a0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27440035b0 con 0x7f275c0746a0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275ad9d700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f275c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 477334425 0 0) 0x7f27440035b0 con 0x7f275c0746a0 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 msgr2=0x7f275c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f275c0afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.187 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 >> v1:172.21.15.176:6789/0 conn(0x7f275c15e160 legacy=0x7f275c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c06bdc0 con 0x7f275c0746a0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f2750001670 con 0x7f275c0746a0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 >> v1:172.21.15.106:6789/0 conn(0x7f275c0746a0 legacy=0x7f275c06d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f2744003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27440040b0 0x7f2744004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2744004d90 0x7f2744005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0b4500 con 0x7f2744004d90 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274400bc50 con 0x7f27440040b0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.182+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274400be10 con 0x7f275c0b5da0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2744004d90 0x7f2744005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f2759d9b700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27440040b0 0x7f2744004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275a59c700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f2744003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.188 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 -- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 msgr2=0x7f2744003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f275c0b5da0 0x7f2744003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 -- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27440040b0 msgr2=0x7f2744004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f27440040b0 0x7f2744004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 -- 172.21.15.106:0/2787161923 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440035b0 con 0x7f2744004d90 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275ad9d700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2744004d90 0x7f2744005210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2754007360 tx=0x7f2744005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec97347fc3c9fd3 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754007e80 con 0x7f2744004d90 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754014400 con 0x7f2744004d90 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.183+0000 7f275959a700 1 -- 172.21.15.106:0/2787161923 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754014790 con 0x7f2744004d90 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 -- 172.21.15.106:0/2787161923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2744004d90 msgr2=0x7f2744005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 --2- 172.21.15.106:0/2787161923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2744004d90 0x7f2744005210 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f2754007360 tx=0x7f2744005880 comp rx=0 tx=0).stop 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f275ad9d700 1 -- 172.21.15.106:0/2787161923 reap_dead start 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 -- 172.21.15.106:0/2787161923 shutdown_connections 2023-11-24T06:14:49.189 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 -- 172.21.15.106:0/2787161923 >> 172.21.15.106:0/2787161923 conn(0x7f275c0d0bf0 msgr2=0x7f275c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 -- 172.21.15.106:0/2787161923 shutdown_connections 2023-11-24T06:14:49.190 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.184+0000 7f2760ed6700 1 -- 172.21.15.106:0/2787161923 wait complete. 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.185+0000 7f2760ed6700 1 Processor -- start 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.185+0000 7f2760ed6700 1 -- start start 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 0x7f275c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 0x7f275c160940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.192 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0c6c30 con 0x7f275c14d540 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0c6110 con 0x7f275c150ab0 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2760ed6700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c14df30 con 0x7f2744004d90 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60042/0 (socket says 172.21.15.106:60042) 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 -- 172.21.15.106:0/446093447 learned_addr learned my addr 172.21.15.106:0/446093447 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275a59c700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 0x7f275c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2759d9b700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 0x7f275c160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 -- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 msgr2=0x7f275c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 0x7f275c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 -- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 msgr2=0x7f275c160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 0x7f275c160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.193 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 -- 172.21.15.106:0/446093447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0c6390 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275a59c700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 0x7f275c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f2759d9b700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 0x7f275c160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.186+0000 7f275ad9d700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2754014000 tx=0x7f2754004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.187+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754007000 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.187+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275401e410 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.187+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0c6670 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.187+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275401e7c0 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.187+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c14e5a0 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.188+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c14e760 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.188+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f275401b050 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.188+0000 7f274affd700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 0x7f273c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.189+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f275408aa40 con 0x7f275c14d540 2023-11-24T06:14:49.194 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.189+0000 7f275a59c700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 0x7f273c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.189+0000 7f275a59c700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 0x7f273c06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f274c007fd0 tx=0x7f274c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.195 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.193+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f275408ce60 con 0x7f275c14d540 2023-11-24T06:14:49.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.381+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f275c068fb0 con 0x7f275c14d540 2023-11-24T06:14:49.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.381+0000 7f274affd700 1 -- 172.21.15.106:0/446093447 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7f275402e0a0 con 0x7f275c14d540 2023-11-24T06:14:49.385 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:49.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 msgr2=0x7f273c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 0x7f273c06d3c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f274c007fd0 tx=0x7f274c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 msgr2=0x7f275c14d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2754014000 tx=0x7f2754004b40 comp rx=0 tx=0).stop 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 shutdown_connections 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f273c06af00 0x7f273c06d3c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f275c14d540 0x7f275c14d9f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2744004d90 0x7f275c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 --2- 172.21.15.106:0/446093447 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f275c150ab0 0x7f275c160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 >> 172.21.15.106:0/446093447 conn(0x7f275c0d0bf0 msgr2=0x7f275c0aef90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 shutdown_connections 2023-11-24T06:14:49.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.383+0000 7f2760ed6700 1 -- 172.21.15.106:0/446093447 wait complete. 2023-11-24T06:14:49.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:49.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.517+0000 7f56a90d7700 1 Processor -- start 2023-11-24T06:14:49.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.517+0000 7f56a90d7700 1 -- start start 2023-11-24T06:14:49.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a406aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56a415b370 0x7f56a415b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 0x7f56a40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a40b4610 con 0x7f56a415b370 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56a406b530 con 0x7f56a40b3c60 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a90d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a40ae5e0 con 0x7f56a41587f0 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a259c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56a415b370 0x7f56a415b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a259c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56a415b370 0x7f56a415b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60046/0 (socket says 172.21.15.106:60046) 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.518+0000 7f56a259c700 1 -- 172.21.15.106:0/4102975393 learned_addr learned my addr 172.21.15.106:0/4102975393 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:49.525 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 -- 172.21.15.106:0/4102975393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 msgr2=0x7f56a406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a406aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a359e700 1 --2- 172.21.15.106:0/4102975393 >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 0x7f56a40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a406aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 -- 172.21.15.106:0/4102975393 >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 msgr2=0x7f56a40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 --2- 172.21.15.106:0/4102975393 >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 0x7f56a40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 -- 172.21.15.106:0/4102975393 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a415be30 con 0x7f56a415b370 2023-11-24T06:14:49.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a359e700 1 --2- 172.21.15.106:0/4102975393 >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 0x7f56a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a259c700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a415b7f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f56a40b4a50 tx=0x7f5694009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faa67f3fa75a351 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a1d9b700 1 -- 172.21.15.106:0/4102975393 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400b870 con 0x7f56a415b370 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a1d9b700 1 -- 172.21.15.106:0/4102975393 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569400b9d0 con 0x7f56a415b370 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.519+0000 7f56a1d9b700 1 -- 172.21.15.106:0/4102975393 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400bd60 con 0x7f56a415b370 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 -- 172.21.15.106:0/4102975393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 msgr2=0x7f56a415b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a415b7f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f56a40b4a50 tx=0x7f5694009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 -- 172.21.15.106:0/4102975393 shutdown_connections 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 --2- 172.21.15.106:0/4102975393 >> v2:172.21.15.176:3300/0 conn(0x7f56a40b3c60 0x7f56a40b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a406aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 --2- 172.21.15.106:0/4102975393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a415b7f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 -- 172.21.15.106:0/4102975393 >> 172.21.15.106:0/4102975393 conn(0x7f56a40d0bf0 msgr2=0x7f56a40d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 -- 172.21.15.106:0/4102975393 shutdown_connections 2023-11-24T06:14:49.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.520+0000 7f56a90d7700 1 -- 172.21.15.106:0/4102975393 wait complete. 2023-11-24T06:14:49.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.521+0000 7f56a90d7700 1 Processor -- start 2023-11-24T06:14:49.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.521+0000 7f56a90d7700 1 -- start start 2023-11-24T06:14:49.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 0x7f56a41efd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a4071bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a41f3c60 con 0x7f56a415b370 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a41f3f40 con 0x7f56a40b3c60 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.522+0000 7f56a90d7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a41f4220 con 0x7f56a41587f0 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60056/0 (socket says 172.21.15.106:60056) 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 -- 172.21.15.106:0/1543598818 learned_addr learned my addr 172.21.15.106:0/1543598818 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a259c700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a4071bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 0x7f56a41efd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.533 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 -- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 msgr2=0x7f56a4071bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a4071bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 -- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 msgr2=0x7f56a41efd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 0x7f56a41efd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 -- 172.21.15.106:0/1543598818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5694009550 con 0x7f56a415b370 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a259c700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 0x7f56a41efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:49.534 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a359e700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f569c00cef0 tx=0x7f569c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c00ae50 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c015440 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a41f4500 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0157f0 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.523+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a41f02d0 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.524+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a4068fb0 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.525+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f569c00d430 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.525+0000 7f568b7fe700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.525+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f569c089bb0 con 0x7f56a415b370 2023-11-24T06:14:49.535 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.525+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.525+0000 7f56a2d9d700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5698006fd0 tx=0x7f5698008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.536 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.529+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f569c054cf0 con 0x7f56a415b370 2023-11-24T06:14:49.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.719+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f56a415b930 con 0x7f56a415b370 2023-11-24T06:14:49.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.720+0000 7f568b7fe700 1 -- 172.21.15.106:0/1543598818 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f569c01a0a0 con 0x7f56a415b370 2023-11-24T06:14:49.723 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:49.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 msgr2=0x7f569006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5698006fd0 tx=0x7f5698008040 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 msgr2=0x7f56a40720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f569c00cef0 tx=0x7f569c00a340 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 shutdown_connections 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f569006aed0 0x7f569006d390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56a415b370 0x7f56a40720f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f56a40b3c60 0x7f56a41efd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 --2- 172.21.15.106:0/1543598818 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f56a41587f0 0x7f56a4071bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 >> 172.21.15.106:0/1543598818 conn(0x7f56a40d0bf0 msgr2=0x7f56a40af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 shutdown_connections 2023-11-24T06:14:49.727 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.722+0000 7f56a90d7700 1 -- 172.21.15.106:0/1543598818 wait complete. 2023-11-24T06:14:49.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:49.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.856+0000 7f5b91b19700 1 Processor -- start 2023-11-24T06:14:49.860 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.856+0000 7f5b91b19700 1 -- start start 2023-11-24T06:14:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b91b19700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b8c0cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.863 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b91b19700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c0d0140 con 0x7f5b8c15bf50 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b91b19700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b8c0d03e0 con 0x7f5b8c0c6c30 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b91b19700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c15c330 con 0x7f5b8c0cf110 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b8b7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5b8c15bf50 0x7f5b8c0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40322/0 (socket says 172.21.15.106:40322) 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b8b7fe700 1 -- 172.21.15.106:0/2560479614 learned_addr learned my addr 172.21.15.106:0/2560479614 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b8c0cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296935787 0 0) 0x7f5b8c0d0140 con 0x7f5b8c15bf50 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.857+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b740035b0 con 0x7f5b8c15bf50 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1273942030 0 0) 0x7f5b740035b0 con 0x7f5b8c15bf50 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 msgr2=0x7f5b8c0cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b8c0cd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 >> v1:172.21.15.176:6789/0 conn(0x7f5b8c0c6c30 legacy=0x7f5b8c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0d06c0 con 0x7f5b8c15bf50 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f5b80001670 con 0x7f5b8c15bf50 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 >> v1:172.21.15.106:6789/0 conn(0x7f5b8c15bf50 legacy=0x7f5b8c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74003a30 0x7f5b74003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b74004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b74004d90 0x7f5b74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c15c330 con 0x7f5b74004d90 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7400bac0 con 0x7f5b74003a30 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7400bc80 con 0x7f5b8c0cf110 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b74004d90 0x7f5b74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8affd700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8b7fe700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74003a30 0x7f5b74003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 -- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 msgr2=0x7f5b74004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0cf110 0x7f5b74004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 -- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74003a30 msgr2=0x7f5b74003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74003a30 0x7f5b74003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 -- 172.21.15.106:0/2560479614 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740035b0 con 0x7f5b74004d90 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8b7fe700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b74003a30 0x7f5b74003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b74004d90 0x7f5b74005210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0cf5a0 tx=0x7f5b74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3e12ea01a1a380 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8400ebd0 con 0x7f5b74004d90 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8400f040 con 0x7f5b74004d90 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.858+0000 7f5b8a7fc700 1 -- 172.21.15.106:0/2560479614 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b84014480 con 0x7f5b74004d90 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 -- 172.21.15.106:0/2560479614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b74004d90 msgr2=0x7f5b74005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2560479614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b74004d90 0x7f5b74005210 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0cf5a0 tx=0x7f5b74005880 comp rx=0 tx=0).stop 2023-11-24T06:14:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b8bfff700 1 -- 172.21.15.106:0/2560479614 reap_dead start 2023-11-24T06:14:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 -- 172.21.15.106:0/2560479614 shutdown_connections 2023-11-24T06:14:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 -- 172.21.15.106:0/2560479614 >> 172.21.15.106:0/2560479614 conn(0x7f5b8c0b3780 msgr2=0x7f5b8c0b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 -- 172.21.15.106:0/2560479614 shutdown_connections 2023-11-24T06:14:49.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.859+0000 7f5b91b19700 1 -- 172.21.15.106:0/2560479614 wait complete. 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.860+0000 7f5b91b19700 1 Processor -- start 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.861+0000 7f5b91b19700 1 -- start start 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 0x7f5b8c1541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 0x7f5b8c0c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c154ba0 con 0x7f5b8c1527c0 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c15cac0 con 0x7f5b8c154720 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8c0b6ba0 con 0x7f5b8c0b66a0 2023-11-24T06:14:49.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60072/0 (socket says 172.21.15.106:60072) 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 -- 172.21.15.106:0/2574991103 learned_addr learned my addr 172.21.15.106:0/2574991103 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8affd700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 0x7f5b8c1541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 -- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 msgr2=0x7f5b8c1541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 0x7f5b8c0c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 0x7f5b8c1541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 -- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 msgr2=0x7f5b8c0c9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 0x7f5b8c0c9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 -- 172.21.15.106:0/2574991103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8c0b6e80 con 0x7f5b8c1527c0 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8affd700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 0x7f5b8c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8bfff700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 0x7f5b8c0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b8b7fe700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000eaf0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000c7b0 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8000c910 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b8c15c470 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000cc80 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.862+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b8c152ba0 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.863+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8c068fb0 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.864+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b8001d460 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.864+0000 7f5b73fff700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.864+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b80089580 con 0x7f5b8c1527c0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.864+0000 7f5b8affd700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:49.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.864+0000 7f5b8affd700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 0x7f5b7806d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0b4690 tx=0x7f5b7c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:49.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:49.868+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b800546c0 con 0x7f5b8c1527c0 2023-11-24T06:14:50.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.062+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b8c0b7ab0 con 0x7f5b8c1527c0 2023-11-24T06:14:50.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.063+0000 7f5b73fff700 1 -- 172.21.15.106:0/2574991103 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b80057ce0 con 0x7f5b8c1527c0 2023-11-24T06:14:50.066 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:50.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.064+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 msgr2=0x7f5b7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.064+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 0x7f5b7806d390 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c0b4690 tx=0x7f5b7c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.064+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 msgr2=0x7f5b8c0cb6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.064+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000eaf0 tx=0x7f5b8000eeb0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 shutdown_connections 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5b7806aed0 0x7f5b7806d390 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5b8c154720 0x7f5b8c0c9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b8c1527c0 0x7f5b8c0cb6e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 --2- 172.21.15.106:0/2574991103 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5b8c0b66a0 0x7f5b8c1541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 >> 172.21.15.106:0/2574991103 conn(0x7f5b8c0b3780 msgr2=0x7f5b8c0c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 shutdown_connections 2023-11-24T06:14:50.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.065+0000 7f5b91b19700 1 -- 172.21.15.106:0/2574991103 wait complete. 2023-11-24T06:14:50.081 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-24T06:14:50.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.198+0000 7fedb0a51700 1 Processor -- start 2023-11-24T06:14:50.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.198+0000 7fedb0a51700 1 -- start start 2023-11-24T06:14:50.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7fedb0a51700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fedac15e1b0 0x7fedac0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7fedb0a51700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b1d40 con 0x7fedac0d2240 2023-11-24T06:14:50.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7fedb0a51700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedac0b28c0 con 0x7fedac15ddd0 2023-11-24T06:14:50.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7fedb0a51700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedac0b1f90 con 0x7fedac15e1b0 2023-11-24T06:14:50.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7feda9d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedac0d2240 0x7fedac06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40342/0 (socket says 172.21.15.106:40342) 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7feda9d9b700 1 -- 172.21.15.106:0/1390462942 learned_addr learned my addr 172.21.15.106:0/1390462942 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221931855 0 0) 0x7fedac0b1d40 con 0x7fedac0d2240 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7fedaad9d700 1 --2- 172.21.15.106:0/1390462942 >> v2:172.21.15.176:3300/0 conn(0x7fedac15e1b0 0x7fedac0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.199+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed940035b0 con 0x7fedac0d2240 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 264376843 0 0) 0x7fed940035b0 con 0x7fedac0d2240 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 >> v2:172.21.15.176:3300/0 conn(0x7fedac15e1b0 msgr2=0x7fedac0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 --2- 172.21.15.106:0/1390462942 >> v2:172.21.15.176:3300/0 conn(0x7fedac15e1b0 0x7fedac0b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 >> v1:172.21.15.176:6789/0 conn(0x7fedac15ddd0 legacy=0x7fedac0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0b2270 con 0x7fedac0d2240 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fed9c001670 con 0x7fedac0d2240 2023-11-24T06:14:50.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 >> v1:172.21.15.106:6789/0 conn(0x7fedac0d2240 legacy=0x7fedac06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fed94003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed94004850 0x7fed94004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed94005330 0x7fed9400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0b1f90 con 0x7fed94003a00 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400c200 con 0x7fed94004850 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9400c3c0 con 0x7fed94005330 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fed94003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda9d9b700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed94004850 0x7fed94004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaad9d700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed94005330 0x7fed9400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 -- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed94005330 msgr2=0x7fed9400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed94005330 0x7fed9400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 -- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed94004850 msgr2=0x7fed94004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fed94004850 0x7fed94004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 -- 172.21.15.106:0/1390462942 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed940035b0 con 0x7fed94003a00 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaad9d700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fed94005330 0x7fed9400ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaad9d700 1 -- 172.21.15.106:0/1390462942 reap_dead start 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7fedaa59c700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fed94003e20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7feda0007fd0 tx=0x7fed94005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d70ae8e4c12b17 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda00052d0 con 0x7fed94003a00 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda0005430 con 0x7fed94003a00 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.200+0000 7feda959a700 1 -- 172.21.15.106:0/1390462942 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda00038c0 con 0x7fed94003a00 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 -- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 msgr2=0x7fed94003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fed94003e20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7feda0007fd0 tx=0x7fed94005880 comp rx=0 tx=0).stop 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 -- 172.21.15.106:0/1390462942 shutdown_connections 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 --2- 172.21.15.106:0/1390462942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fed94003e20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 -- 172.21.15.106:0/1390462942 >> 172.21.15.106:0/1390462942 conn(0x7fedac0731a0 msgr2=0x7fedac09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 -- 172.21.15.106:0/1390462942 shutdown_connections 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.201+0000 7fedb0a51700 1 -- 172.21.15.106:0/1390462942 wait complete. 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.202+0000 7fedb0a51700 1 Processor -- start 2023-11-24T06:14:50.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.202+0000 7fedb0a51700 1 -- start start 2023-11-24T06:14:50.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedac15e5c0 0x7fedac0b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac0b5070 0x7fedac0b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac0b66b0 con 0x7fed94003a00 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedac14afa0 con 0x7fedac0b5070 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedb0a51700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedac160ef0 con 0x7fedac15e5c0 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedaa59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedaa59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60092/0 (socket says 172.21.15.106:60092) 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedaa59c700 1 -- 172.21.15.106:0/3303757888 learned_addr learned my addr 172.21.15.106:0/3303757888 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.203+0000 7fedaad9d700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac0b5070 0x7fedac0b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 -- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedac15e5c0 msgr2=0x7fedac0b4b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedac15e5c0 0x7fedac0b4b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 -- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac0b5070 msgr2=0x7fedac0b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac0b5070 0x7fedac0b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 -- 172.21.15.106:0/3303757888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac0b2ed0 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedaa59c700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feda0015040 tx=0x7feda0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda0001290 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feda001d480 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda001d810 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedac161470 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.204+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedac15ea50 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.205+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedac067f60 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.206+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feda0019040 con 0x7fed94003a00 2023-11-24T06:14:50.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.206+0000 7fed9affd700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 0x7fed8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.206+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feda008a470 con 0x7fed94003a00 2023-11-24T06:14:50.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.206+0000 7feda9d9b700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 0x7fed8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.206+0000 7feda9d9b700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 0x7fed8c06d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0011e0 tx=0x7fed9c000ed0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.210+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feda0055690 con 0x7fed94003a00 2023-11-24T06:14:50.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.416+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fedac0b7c60 con 0x7fed94003a00 2023-11-24T06:14:50.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.416+0000 7fed9affd700 1 -- 172.21.15.106:0/3303757888 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v33) v1 ==== 80+0+0 (secure 0 0 0) 0x7feda0017080 con 0x7fed94003a00 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 msgr2=0x7fed8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 0x7fed8c06d390 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fed9c0011e0 tx=0x7fed9c000ed0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 msgr2=0x7fedac0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feda0015040 tx=0x7feda0001120 comp rx=0 tx=0).stop 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 shutdown_connections 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fed8c06aed0 0x7fed8c06d390 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fedac0b5070 0x7fedac0b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.423 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed94003a00 0x7fedac0b6170 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 --2- 172.21.15.106:0/3303757888 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fedac15e5c0 0x7fedac0b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 >> 172.21.15.106:0/3303757888 conn(0x7fedac0731a0 msgr2=0x7fedac0cec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 shutdown_connections 2023-11-24T06:14:50.424 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.419+0000 7fedb0a51700 1 -- 172.21.15.106:0/3303757888 wait complete. 2023-11-24T06:14:50.424 INFO:teuthology.orchestra.run.smithi106.stderr:listed 0 entries 2023-11-24T06:14:50.434 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-11-24T06:14:50.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:50.435 DEBUG:teuthology.orchestra.run.smithi176:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-11-24T06:14:50.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:14:50.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:14:50.482 DEBUG:teuthology.orchestra.run.smithi176:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-11-24T06:14:50.501 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:14:50.501 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:50.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T06:14:50.519 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:14:50.519 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:14:50.560 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1477 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T06:14:50.560 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:50.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.676+0000 7f0602907700 1 Processor -- start 2023-11-24T06:14:50.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.676+0000 7f0602907700 1 -- start start 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f0602907700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc152cc0 0x7f05fc06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f0602907700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05fc0b49a0 0x7f05fc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f0602907700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc15c4b0 con 0x7f05fc0cff20 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f0602907700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05fc15c790 con 0x7f05fc0b49a0 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f0602907700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc15ca70 con 0x7f05fc152cc0 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f05fb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05fc0b49a0 0x7f05fc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f05fb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05fc0b49a0 0x7f05fc06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60102/0 (socket says 172.21.15.106:60102) 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.677+0000 7f05fb7fe700 1 -- 172.21.15.106:0/1155255331 learned_addr learned my addr 172.21.15.106:0/1155255331 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fbfff700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc152cc0 0x7f05fc06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fb7fe700 1 -- 172.21.15.106:0/1155255331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc152cc0 msgr2=0x7f05fc06c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fb7fe700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc152cc0 0x7f05fc06c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fb7fe700 1 -- 172.21.15.106:0/1155255331 >> v1:172.21.15.176:6789/0 conn(0x7f05fc0cff20 legacy=0x7f05fc0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fb7fe700 1 -- 172.21.15.106:0/1155255331 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc15cd50 con 0x7f05fc0b49a0 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05fb7fe700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0b49a0 0x7f05fc06c540 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0098f0 tx=0x7f05ec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956b6b3aa8ee5338 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05faffd700 1 -- 172.21.15.106:0/1155255331 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00b8a0 con 0x7f05fc0b49a0 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05faffd700 1 -- 172.21.15.106:0/1155255331 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec00ba00 con 0x7f05fc0b49a0 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.678+0000 7f05faffd700 1 -- 172.21.15.106:0/1155255331 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05ec00bd90 con 0x7f05fc0b49a0 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 -- 172.21.15.106:0/1155255331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0b49a0 msgr2=0x7f05fc06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0b49a0 0x7f05fc06c540 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0098f0 tx=0x7f05ec009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 -- 172.21.15.106:0/1155255331 shutdown_connections 2023-11-24T06:14:50.684 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc152cc0 0x7f05fc06c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 --2- 172.21.15.106:0/1155255331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0b49a0 0x7f05fc06c540 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 -- 172.21.15.106:0/1155255331 >> 172.21.15.106:0/1155255331 conn(0x7f05fc071b90 msgr2=0x7f05fc071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 -- 172.21.15.106:0/1155255331 shutdown_connections 2023-11-24T06:14:50.685 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.679+0000 7f0602907700 1 -- 172.21.15.106:0/1155255331 wait complete. 2023-11-24T06:14:50.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.680+0000 7f0602907700 1 Processor -- start 2023-11-24T06:14:50.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.680+0000 7f0602907700 1 -- start start 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05fc0b49a0 0x7f05fc1475f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 0x7f05fc15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1532b0 con 0x7f05fc152cc0 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1577a0 con 0x7f05fc0b49a0 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1f52c0 con 0x7f05fc0cff20 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60110/0 (socket says 172.21.15.106:60110) 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 -- 172.21.15.106:0/41468452 learned_addr learned my addr 172.21.15.106:0/41468452 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:50.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05fb7fe700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 0x7f05fc15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05fbfff700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05fc0b49a0 0x7f05fc1475f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 -- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 msgr2=0x7f05fc15ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 0x7f05fc15ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 -- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05fc0b49a0 msgr2=0x7f05fc1475f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05fc0b49a0 0x7f05fc1475f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 -- 172.21.15.106:0/41468452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009550 con 0x7f05fc152cc0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05fb7fe700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 0x7f05fc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0600ea4700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cc50 tx=0x7f05f400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f400ad80 con 0x7f05fc152cc0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400ce50 con 0x7f05fc152cc0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4003c40 con 0x7f05fc152cc0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.681+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc1f55a0 con 0x7f05fc152cc0 2023-11-24T06:14:50.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.682+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc1f5b60 con 0x7f05fc152cc0 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.682+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc0753f0 con 0x7f05fc152cc0 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.683+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05f40050d0 con 0x7f05fc152cc0 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.683+0000 7f05f8ff9700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 0x7f05e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.683+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05f4089660 con 0x7f05fc152cc0 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.683+0000 7f05fbfff700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 0x7f05e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.684+0000 7f05fbfff700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 0x7f05e806d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05f000b9b0 tx=0x7f05f0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.688+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05f40547a0 con 0x7f05fc152cc0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.920+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05fc067f60 con 0x7f05fc152cc0 2023-11-24T06:14:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.921+0000 7f05f8ff9700 1 -- 172.21.15.106:0/41468452 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f05f4057dc0 con 0x7f05fc152cc0 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:50.925 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 msgr2=0x7f05e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 0x7f05e806d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f05f000b9b0 tx=0x7f05f0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 msgr2=0x7f05fc0b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f05f400cc50 tx=0x7f05f400a340 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 shutdown_connections 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f05e806aed0 0x7f05e806d390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc152cc0 0x7f05fc0b1c60 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f05fc0b49a0 0x7f05fc1475f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 --2- 172.21.15.106:0/41468452 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05fc0cff20 0x7f05fc15ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 >> 172.21.15.106:0/41468452 conn(0x7f05fc071b90 msgr2=0x7f05fc0adf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 shutdown_connections 2023-11-24T06:14:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:50.923+0000 7f0602907700 1 -- 172.21.15.106:0/41468452 wait complete. 2023-11-24T06:14:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2023-11-24T06:14:50.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:51.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.055+0000 7fe127e14700 1 Processor -- start 2023-11-24T06:14:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.055+0000 7fe127e14700 1 -- start start 2023-11-24T06:14:51.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe127e14700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe1201446a0 0x7fe1200b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe127e14700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe12006c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe127e14700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200af950 con 0x7fe12006c540 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe127e14700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe120144a80 con 0x7fe1201446a0 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe127e14700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12006c9b0 con 0x7fe1200adf00 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe1263b1700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe12006c540 0x7fe12006da30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40380/0 (socket says 172.21.15.106:40380) 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe1263b1700 1 -- 172.21.15.106:0/3932410411 learned_addr learned my addr 172.21.15.106:0/3932410411 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:51.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166834040 0 0) 0x7fe1200af950 con 0x7fe12006c540 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe1253af700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe12006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe10c0035b0 con 0x7fe12006c540 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe125bb0700 1 --2- 172.21.15.106:0/3932410411 >> v2:172.21.15.176:3300/0 conn(0x7fe1201446a0 0x7fe1200b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3391716611 0 0) 0x7fe10c0035b0 con 0x7fe12006c540 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 msgr2=0x7fe12006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe12006c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.072 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 >> v2:172.21.15.176:3300/0 conn(0x7fe1201446a0 msgr2=0x7fe1200b5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 --2- 172.21.15.106:0/3932410411 >> v2:172.21.15.176:3300/0 conn(0x7fe1201446a0 0x7fe1200b5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200afc30 con 0x7fe12006c540 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.056+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fe1180019f0 con 0x7fe12006c540 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 >> v1:172.21.15.106:6789/0 conn(0x7fe12006c540 legacy=0x7fe12006da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c003a30 0x7fe10c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe10c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe10c004d90 0x7fe10c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe120144a80 con 0x7fe10c004d90 2023-11-24T06:14:51.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12006c9b0 con 0x7fe10c003a30 2023-11-24T06:14:51.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe10c00ba10 con 0x7fe1200adf00 2023-11-24T06:14:51.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe10c004d90 0x7fe10c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1253af700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe10c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe125bb0700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c003a30 0x7fe10c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 -- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 msgr2=0x7fe10c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200adf00 0x7fe10c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 -- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c003a30 msgr2=0x7fe10c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c003a30 0x7fe10c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 -- 172.21.15.106:0/3932410411 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10c0035b0 con 0x7fe10c004d90 2023-11-24T06:14:51.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe1263b1700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe10c004d90 0x7fe10c005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe11800a860 tx=0x7fe10c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88846327b504377e server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11800a2f0 con 0x7fe10c004d90 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118012600 con 0x7fe10c004d90 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.057+0000 7fe124bae700 1 -- 172.21.15.106:0/3932410411 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1180129b0 con 0x7fe10c004d90 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 -- 172.21.15.106:0/3932410411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe10c004d90 msgr2=0x7fe10c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 --2- 172.21.15.106:0/3932410411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe10c004d90 0x7fe10c005210 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe11800a860 tx=0x7fe10c005880 comp rx=0 tx=0).stop 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe1263b1700 1 -- 172.21.15.106:0/3932410411 reap_dead start 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 -- 172.21.15.106:0/3932410411 shutdown_connections 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 -- 172.21.15.106:0/3932410411 >> 172.21.15.106:0/3932410411 conn(0x7fe120071b90 msgr2=0x7fe120071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 -- 172.21.15.106:0/3932410411 shutdown_connections 2023-11-24T06:14:51.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.058+0000 7fe127e14700 1 -- 172.21.15.106:0/3932410411 wait complete. 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.059+0000 7fe127e14700 1 Processor -- start 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.059+0000 7fe127e14700 1 -- start start 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 0x7fe12013cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200cffc0 0x7fe1200cd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015c330 con 0x7fe1200d0440 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015c610 con 0x7fe10c004d90 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe127e14700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12013f9c0 con 0x7fe1200cffc0 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60130/0 (socket says 172.21.15.106:60130) 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 -- 172.21.15.106:0/947085879 learned_addr learned my addr 172.21.15.106:0/947085879 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:51.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1253af700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200cffc0 0x7fe1200cd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe125bb0700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 0x7fe12013cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 -- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200cffc0 msgr2=0x7fe1200cd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200cffc0 0x7fe1200cd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 -- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 msgr2=0x7fe12013cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 0x7fe12013cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 -- 172.21.15.106:0/947085879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe12013fca0 con 0x7fe1200d0440 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe125bb0700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 0x7fe12013cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1263b1700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe118012000 tx=0x7fe118001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1180017b0 con 0x7fe1200d0440 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.060+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe118001930 con 0x7fe1200d0440 2023-11-24T06:14:51.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.061+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12013ff80 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.061+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11801e670 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.061+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe12013d0a0 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.061+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1200753f0 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.062+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe11801e7d0 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.062+0000 7fe1167fc700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 0x7fe10406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.062+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe11808b4a0 con 0x7fe1200d0440 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.062+0000 7fe125bb0700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 0x7fe10406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.063+0000 7fe125bb0700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 0x7fe10406d320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe110009c60 tx=0x7fe110008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.079 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.067+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1180565e0 con 0x7fe1200d0440 2023-11-24T06:14:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.257+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe120067f60 con 0x7fe1200d0440 2023-11-24T06:14:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.259+0000 7fe1167fc700 1 -- 172.21.15.106:0/947085879 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fe118059c00 con 0x7fe1200d0440 2023-11-24T06:14:51.262 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:51.263 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.260+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 msgr2=0x7fe10406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.260+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 0x7fe10406d320 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe110009c60 tx=0x7fe110008040 comp rx=0 tx=0).stop 2023-11-24T06:14:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.260+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 msgr2=0x7fe1200cdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.260+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe118012000 tx=0x7fe118001d80 comp rx=0 tx=0).stop 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 shutdown_connections 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe10406ae60 0x7fe10406d320 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1200d0440 0x7fe1200cdb40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe10c004d90 0x7fe12013cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 --2- 172.21.15.106:0/947085879 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe1200cffc0 0x7fe1200cd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 >> 172.21.15.106:0/947085879 conn(0x7fe120071b90 msgr2=0x7fe1200b1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 shutdown_connections 2023-11-24T06:14:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.261+0000 7fe127e14700 1 -- 172.21.15.106:0/947085879 wait complete. 2023-11-24T06:14:51.276 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-24T06:14:33.757193+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-11-24T06:14:34.919394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:51.277 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.395+0000 7fdf4cd16700 1 Processor -- start 2023-11-24T06:14:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.395+0000 7fdf4cd16700 1 -- start start 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.396+0000 7fdf4cd16700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf480ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.396+0000 7fdf4cd16700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fdf480ce830 0x7fdf480cecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.396+0000 7fdf4cd16700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480d0140 con 0x7fdf480cf1f0 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.396+0000 7fdf4cd16700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4815c330 con 0x7fdf480ce830 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.396+0000 7fdf4cd16700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480d03e0 con 0x7fdf4815bf50 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf46d9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdf480cf1f0 0x7fdf480c5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40398/0 (socket says 172.21.15.106:40398) 2023-11-24T06:14:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf46d9d700 1 -- 172.21.15.106:0/1274045578 learned_addr learned my addr 172.21.15.106:0/1274045578 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf480ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1274045578 >> v2:172.21.15.176:3300/0 conn(0x7fdf480ce830 0x7fdf480cecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430574808 0 0) 0x7fdf480d0140 con 0x7fdf480cf1f0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf300035b0 con 0x7fdf480cf1f0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232459473 0 0) 0x7fdf300035b0 con 0x7fdf480cf1f0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 msgr2=0x7fdf480ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf480ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 >> v2:172.21.15.176:3300/0 conn(0x7fdf480ce830 msgr2=0x7fdf480cecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 --2- 172.21.15.106:0/1274045578 >> v2:172.21.15.176:3300/0 conn(0x7fdf480ce830 0x7fdf480cecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480d06c0 con 0x7fdf480cf1f0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fdf38001670 con 0x7fdf480cf1f0 2023-11-24T06:14:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1274045578 >> v2:172.21.15.176:3300/0 conn(0x7fdf480ce830 0x7fdf480cecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 >> v1:172.21.15.106:6789/0 conn(0x7fdf480cf1f0 legacy=0x7fdf480c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf30003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf30004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf30004d90 0x7fdf30005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4815c330 con 0x7fdf30003a00 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480d03e0 con 0x7fdf30004d90 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3000ba10 con 0x7fdf4815bf50 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf30003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf30004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.397+0000 7fdf46d9d700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf30004d90 0x7fdf30005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 -- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 msgr2=0x7fdf30004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4815bf50 0x7fdf30004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 -- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf30004d90 msgr2=0x7fdf30005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf30004d90 0x7fdf30005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 -- 172.21.15.106:0/1274045578 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300035b0 con 0x7fdf30003a00 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf46d9d700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf30004d90 0x7fdf30005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf30003e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009fc0 tx=0x7fdf30005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5dcc9d72d385d7 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4000ec30 con 0x7fdf30003a00 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf4000f040 con 0x7fdf30003a00 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4559a700 1 -- 172.21.15.106:0/1274045578 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40014480 con 0x7fdf30003a00 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1274045578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 msgr2=0x7fdf30003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1274045578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf30003e20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fdf40009fc0 tx=0x7fdf30005880 comp rx=0 tx=0).stop 2023-11-24T06:14:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf46d9d700 1 -- 172.21.15.106:0/1274045578 reap_dead start 2023-11-24T06:14:51.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1274045578 shutdown_connections 2023-11-24T06:14:51.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.398+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1274045578 >> 172.21.15.106:0/1274045578 conn(0x7fdf480b3780 msgr2=0x7fdf480b3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.399+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1274045578 shutdown_connections 2023-11-24T06:14:51.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.399+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1274045578 wait complete. 2023-11-24T06:14:51.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.400+0000 7fdf4cd16700 1 Processor -- start 2023-11-24T06:14:51.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.400+0000 7fdf4cd16700 1 -- start start 2023-11-24T06:14:51.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480ca270 0x7fdf481f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.409 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4814c2e0 0x7fdf480b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf481f7ed0 con 0x7fdf30003a00 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4814cb80 con 0x7fdf480ca270 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4814ce60 con 0x7fdf4814c2e0 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60146/0 (socket says 172.21.15.106:60146) 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 -- 172.21.15.106:0/1884143802 learned_addr learned my addr 172.21.15.106:0/1884143802 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf46d9d700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4814c2e0 0x7fdf480b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480ca270 0x7fdf481f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 -- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4814c2e0 msgr2=0x7fdf480b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4814c2e0 0x7fdf480b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.410 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 -- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480ca270 msgr2=0x7fdf481f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480ca270 0x7fdf481f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 -- 172.21.15.106:0/1884143802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4814d140 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4659c700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000ef30 tx=0x7fdf40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40004450 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf400045f0 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4806b9d0 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40014480 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.401+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf481f6cb0 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.402+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf4806c020 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.403+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdf400145e0 con 0x7fdf30003a00 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.403+0000 7fdf36ffd700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 0x7fdf2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.403+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 0x7fdf2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.411 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.403+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf4008b370 con 0x7fdf30003a00 2023-11-24T06:14:51.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.404+0000 7fdf45d9b700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 0x7fdf2806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009cd0 tx=0x7fdf3c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.412 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.408+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdf400565d0 con 0x7fdf30003a00 2023-11-24T06:14:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.600+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf480c5680 con 0x7fdf30003a00 2023-11-24T06:14:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.601+0000 7fdf36ffd700 1 -- 172.21.15.106:0/1884143802 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v33) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf40059bf0 con 0x7fdf30003a00 2023-11-24T06:14:51.604 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 msgr2=0x7fdf2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 0x7fdf2806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009cd0 tx=0x7fdf3c008040 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 msgr2=0x7fdf481f7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdf4000ef30 tx=0x7fdf40009750 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 shutdown_connections 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fdf2806aed0 0x7fdf2806d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fdf4814c2e0 0x7fdf480b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf30003a00 0x7fdf481f7990 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 --2- 172.21.15.106:0/1884143802 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fdf480ca270 0x7fdf481f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 >> 172.21.15.106:0/1884143802 conn(0x7fdf480b3780 msgr2=0x7fdf480c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 shutdown_connections 2023-11-24T06:14:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.603+0000 7fdf4cd16700 1 -- 172.21.15.106:0/1884143802 wait complete. 2023-11-24T06:14:51.618 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-24T06:14:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 Processor -- start 2023-11-24T06:14:51.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 -- start start 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f71ec0b4230 0x7f71ec06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71ec0ceb70 0x7f71ec0cce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71ec0cf550 con 0x7f71ec15e2d0 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec15e6b0 con 0x7f71ec0ceb70 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.739+0000 7f71f11cd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71ec0cc9b0 con 0x7f71ec0b4230 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71ec0ceb70 0x7f71ec0cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71ec0ceb70 0x7f71ec0cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60158/0 (socket says 172.21.15.106:60158) 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 -- 172.21.15.106:0/1916321511 learned_addr learned my addr 172.21.15.106:0/1916321511 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:51.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71ea59c700 1 --2- 172.21.15.106:0/1916321511 >> v2:172.21.15.176:3300/0 conn(0x7f71ec0b4230 0x7f71ec06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 -- 172.21.15.106:0/1916321511 >> v2:172.21.15.176:3300/0 conn(0x7f71ec0b4230 msgr2=0x7f71ec06ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 --2- 172.21.15.106:0/1916321511 >> v2:172.21.15.176:3300/0 conn(0x7f71ec0b4230 0x7f71ec06ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 -- 172.21.15.106:0/1916321511 >> v1:172.21.15.176:6789/0 conn(0x7f71ec15e2d0 legacy=0x7f71ec0ce460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 -- 172.21.15.106:0/1916321511 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ec0cf020 con 0x7f71ec0ceb70 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71eb59e700 1 --2- 172.21.15.106:0/1916321511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec0ceb70 0x7f71ec0cce40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0709e0 tx=0x7f71e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f943a2d4a9e3e264 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71e9d9b700 1 -- 172.21.15.106:0/1916321511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e400e070 con 0x7f71ec0ceb70 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71e9d9b700 1 -- 172.21.15.106:0/1916321511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e4003a20 con 0x7f71ec0ceb70 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.740+0000 7f71e9d9b700 1 -- 172.21.15.106:0/1916321511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4003dd0 con 0x7f71ec0ceb70 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 -- 172.21.15.106:0/1916321511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec0ceb70 msgr2=0x7f71ec0cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 --2- 172.21.15.106:0/1916321511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec0ceb70 0x7f71ec0cce40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f71ec0709e0 tx=0x7f71e400b330 comp rx=0 tx=0).stop 2023-11-24T06:14:51.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 -- 172.21.15.106:0/1916321511 shutdown_connections 2023-11-24T06:14:51.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 --2- 172.21.15.106:0/1916321511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec0ceb70 0x7f71ec0cce40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 --2- 172.21.15.106:0/1916321511 >> v2:172.21.15.176:3300/0 conn(0x7f71ec0b4230 0x7f71ec06ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 -- 172.21.15.106:0/1916321511 >> 172.21.15.106:0/1916321511 conn(0x7f71ec0b3710 msgr2=0x7f71ec0b3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 -- 172.21.15.106:0/1916321511 shutdown_connections 2023-11-24T06:14:51.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.741+0000 7f71f11cd700 1 -- 172.21.15.106:0/1916321511 wait complete. 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.742+0000 7f71f11cd700 1 Processor -- start 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.742+0000 7f71f11cd700 1 -- start start 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 0x7f71ec15bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 0x7f71ec0b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec15f470 con 0x7f71ec15e2d0 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec15f750 con 0x7f71ec0b4230 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71f11cd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71ec0b4980 con 0x7f71ec0ceb70 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.750 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60164/0 (socket says 172.21.15.106:60164) 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 -- 172.21.15.106:0/2083920937 learned_addr learned my addr 172.21.15.106:0/2083920937 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71ea59c700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 0x7f71ec0b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71ead9d700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 0x7f71ec15bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 -- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 msgr2=0x7f71ec0b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 0x7f71ec0b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 -- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 msgr2=0x7f71ec15bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 0x7f71ec15bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71eb59e700 1 -- 172.21.15.106:0/2083920937 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e4009b30 con 0x7f71ec15e2d0 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71ea59c700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 0x7f71ec0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.743+0000 7f71ead9d700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 0x7f71ec15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:51.751 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71eb59e700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71e4015040 tx=0x7f71e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004240 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e40043c0 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71ec0b4c60 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e4004770 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.744+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71ec0c9c50 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.745+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71ec0b4df0 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.745+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f71e4019070 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.745+0000 7f71d37fe700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 0x7f71d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.745+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71e408a660 con 0x7f71ec15e2d0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.745+0000 7f71ead9d700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 0x7f71d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:51.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.746+0000 7f71ead9d700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 0x7f71d806d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71dc006fd0 tx=0x7f71dc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:51.753 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.750+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f71e4055680 con 0x7f71ec15e2d0 2023-11-24T06:14:51.942 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.939+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f71ec0cc620 con 0x7f71ec15e2d0 2023-11-24T06:14:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.939+0000 7f71d37fe700 1 -- 172.21.15.106:0/2083920937 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v33) v1 ==== 104+0+11 (secure 0 0 0) 0x7f71ec0cc620 con 0x7f71ec15e2d0 2023-11-24T06:14:51.943 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 32 2023-11-24T06:14:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 msgr2=0x7f71d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 0x7f71d806d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f71dc006fd0 tx=0x7f71dc008040 comp rx=0 tx=0).stop 2023-11-24T06:14:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 msgr2=0x7f71ec0b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f71e4015040 tx=0x7f71e4004ad0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 shutdown_connections 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f71d806aed0 0x7f71d806d390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71ec15e2d0 0x7f71ec0b7330 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f71ec0b4230 0x7f71ec15bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 --2- 172.21.15.106:0/2083920937 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f71ec0ceb70 0x7f71ec0b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 >> 172.21.15.106:0/2083920937 conn(0x7f71ec0b3710 msgr2=0x7f71ec0b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 shutdown_connections 2023-11-24T06:14:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:51.941+0000 7f71f11cd700 1 -- 172.21.15.106:0/2083920937 wait complete. 2023-11-24T06:14:51.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-24T06:14:52.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.078+0000 7fbee960d700 1 Processor -- start 2023-11-24T06:14:52.081 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.078+0000 7fbee960d700 1 -- start start 2023-11-24T06:14:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee960d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbee40d39d0 0x7fbee40b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee960d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee40d2930 con 0x7fbee415e140 2023-11-24T06:14:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee960d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee40d2c10 con 0x7fbee40d45d0 2023-11-24T06:14:52.084 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee960d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee415e520 con 0x7fbee40d39d0 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee2ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbee415e140 0x7fbee40d3ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40430/0 (socket says 172.21.15.106:40430) 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee2ffd700 1 -- 172.21.15.106:0/4223875675 learned_addr learned my addr 172.21.15.106:0/4223875675 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485178994 0 0) 0x7fbee40d2930 con 0x7fbee415e140 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbecc0035b0 con 0x7fbee415e140 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.079+0000 7fbee37fe700 1 --2- 172.21.15.106:0/4223875675 >> v2:172.21.15.176:3300/0 conn(0x7fbee40d39d0 0x7fbee40b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 819164688 0 0) 0x7fbecc0035b0 con 0x7fbee415e140 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 >> v2:172.21.15.176:3300/0 conn(0x7fbee40d39d0 msgr2=0x7fbee40b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 --2- 172.21.15.106:0/4223875675 >> v2:172.21.15.176:3300/0 conn(0x7fbee40d39d0 0x7fbee40b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 >> v1:172.21.15.176:6789/0 conn(0x7fbee40d45d0 legacy=0x7fbee40b70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40d2ef0 con 0x7fbee415e140 2023-11-24T06:14:52.085 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fbed8001670 con 0x7fbee415e140 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 >> v1:172.21.15.106:6789/0 conn(0x7fbee415e140 legacy=0x7fbee40d3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc003a00 0x7fbecc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 0x7fbecc004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbecc005210 0x7fbecc00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee415e520 con 0x7fbecc004850 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc00c0b0 con 0x7fbecc005210 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc00c270 con 0x7fbecc003a00 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 0x7fbecc004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee37fe700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbecc005210 0x7fbecc00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee2ffd700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc003a00 0x7fbecc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.086 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 -- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc003a00 msgr2=0x7fbecc003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc003a00 0x7fbecc003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 -- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbecc005210 msgr2=0x7fbecc00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbecc005210 0x7fbecc00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 -- 172.21.15.106:0/4223875675 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0035b0 con 0x7fbecc004850 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee37fe700 1 -- 172.21.15.106:0/4223875675 reap_dead start 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee2ffd700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc003a00 0x7fbecc003e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee27fc700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 0x7fbecc004cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbed40017c0 tx=0x7fbecc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23b1d66fd223b2a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40052d0 con 0x7fbecc004850 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed4005450 con 0x7fbecc004850 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.080+0000 7fbee1ffb700 1 -- 172.21.15.106:0/4223875675 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed40038c0 con 0x7fbecc004850 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 -- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 msgr2=0x7fbecc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.087 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 0x7fbecc004cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fbed40017c0 tx=0x7fbecc005880 comp rx=0 tx=0).stop 2023-11-24T06:14:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 -- 172.21.15.106:0/4223875675 shutdown_connections 2023-11-24T06:14:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 --2- 172.21.15.106:0/4223875675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbecc004850 0x7fbecc004cd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 -- 172.21.15.106:0/4223875675 >> 172.21.15.106:0/4223875675 conn(0x7fbee406b410 msgr2=0x7fbee406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 -- 172.21.15.106:0/4223875675 shutdown_connections 2023-11-24T06:14:52.088 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.081+0000 7fbee960d700 1 -- 172.21.15.106:0/4223875675 wait complete. 2023-11-24T06:14:52.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.082+0000 7fbee960d700 1 Processor -- start 2023-11-24T06:14:52.090 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.082+0000 7fbee960d700 1 -- start start 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc004850 0x7fbee41f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 0x7fbee41f7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee41f7ba0 con 0x7fbee40ca460 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cb780 con 0x7fbee41f4770 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee960d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee40cb990 con 0x7fbecc004850 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee37fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60184/0 (socket says 172.21.15.106:60184) 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee37fe700 1 -- 172.21.15.106:0/2261992824 learned_addr learned my addr 172.21.15.106:0/2261992824 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee27fc700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 0x7fbee41f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.083+0000 7fbee2ffd700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc004850 0x7fbee41f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.091 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 -- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc004850 msgr2=0x7fbee41f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc004850 0x7fbee41f6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 -- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 msgr2=0x7fbee41f7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 0x7fbee41f7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 -- 172.21.15.106:0/2261992824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee40cbec0 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee27fc700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 0x7fbee41f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee37fe700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbedc011b40 tx=0x7fbedc011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00e040 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbedc00f040 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee40cbbe0 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbedc00fd80 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.084+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee40cb410 con 0x7fbee40ca460 2023-11-24T06:14:52.092 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.085+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee4068fb0 con 0x7fbee40ca460 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.085+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbedc015430 con 0x7fbee40ca460 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.085+0000 7fbecb7fe700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 0x7fbed006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.086+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbedc089ec0 con 0x7fbee40ca460 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.086+0000 7fbee2ffd700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 0x7fbed006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.086+0000 7fbee2ffd700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 0x7fbed006d390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000fb0 tx=0x7fbed8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.093 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.090+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbedc055000 con 0x7fbee40ca460 2023-11-24T06:14:52.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.280+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbee40b8520 con 0x7fbee40ca460 2023-11-24T06:14:52.283 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.281+0000 7fbecb7fe700 1 -- 172.21.15.106:0/2261992824 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v33) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbedc058620 con 0x7fbee40ca460 2023-11-24T06:14:52.283 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 64 2023-11-24T06:14:52.285 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.282+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 msgr2=0x7fbed006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.282+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 0x7fbed006d390 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbed8000fb0 tx=0x7fbed8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.282+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 msgr2=0x7fbee415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.282+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fbedc011b40 tx=0x7fbedc011f00 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 shutdown_connections 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbed006aed0 0x7fbed006d390 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbee40ca460 0x7fbee415ade0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbecc004850 0x7fbee41f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 --2- 172.21.15.106:0/2261992824 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbee41f4770 0x7fbee41f7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 >> 172.21.15.106:0/2261992824 conn(0x7fbee406b410 msgr2=0x7fbee40b89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.286 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 shutdown_connections 2023-11-24T06:14:52.287 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.283+0000 7fbee960d700 1 -- 172.21.15.106:0/2261992824 wait complete. 2023-11-24T06:14:52.297 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:52.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.415+0000 7ff094eeb700 1 Processor -- start 2023-11-24T06:14:52.418 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.415+0000 7ff094eeb700 1 -- start start 2023-11-24T06:14:52.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff094eeb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff09006c710 0x7ff0900b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff094eeb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff0900af4d0 0x7ff0900afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff094eeb700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0900ae430 con 0x7ff09015e080 2023-11-24T06:14:52.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff094eeb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900af0b0 con 0x7ff09006c710 2023-11-24T06:14:52.420 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff094eeb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900b05a0 con 0x7ff0900af4d0 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08dd9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff09006c710 0x7ff0900b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08e59c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff09015e080 0x7ff09006c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40450/0 (socket says 172.21.15.106:40450) 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08e59c700 1 -- 172.21.15.106:0/1799167690 learned_addr learned my addr 172.21.15.106:0/1799167690 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08ed9d700 1 --2- 172.21.15.106:0/1799167690 >> v2:172.21.15.176:3300/0 conn(0x7ff0900af4d0 0x7ff0900afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08dd9b700 1 -- 172.21.15.106:0/1799167690 >> v2:172.21.15.176:3300/0 conn(0x7ff0900af4d0 msgr2=0x7ff0900afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08dd9b700 1 --2- 172.21.15.106:0/1799167690 >> v2:172.21.15.176:3300/0 conn(0x7ff0900af4d0 0x7ff0900afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08dd9b700 1 -- 172.21.15.106:0/1799167690 >> v1:172.21.15.106:6789/0 conn(0x7ff09015e080 legacy=0x7ff09006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08d59a700 1 -- 172.21.15.106:0/1799167690 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 892026340 0 0) 0x7ff0900ae430 con 0x7ff09015e080 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.416+0000 7ff08dd9b700 1 -- 172.21.15.106:0/1799167690 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900ae710 con 0x7ff09006c710 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff08dd9b700 1 --2- 172.21.15.106:0/1799167690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09006c710 0x7ff0900b5050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff09009eea0 tx=0x7ff080009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a142c7b749831280 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.421 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff08d59a700 1 -- 172.21.15.106:0/1799167690 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011830 con 0x7ff09006c710 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff08d59a700 1 -- 172.21.15.106:0/1799167690 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff080011990 con 0x7ff09006c710 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff08d59a700 1 -- 172.21.15.106:0/1799167690 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff080011d20 con 0x7ff09006c710 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 -- 172.21.15.106:0/1799167690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09006c710 msgr2=0x7ff0900b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1799167690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09006c710 0x7ff0900b5050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff09009eea0 tx=0x7ff080009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 -- 172.21.15.106:0/1799167690 shutdown_connections 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1799167690 >> v2:172.21.15.176:3300/0 conn(0x7ff0900af4d0 0x7ff0900afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1799167690 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09006c710 0x7ff0900b5050 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 -- 172.21.15.106:0/1799167690 >> 172.21.15.106:0/1799167690 conn(0x7ff090071b90 msgr2=0x7ff090071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 -- 172.21.15.106:0/1799167690 shutdown_connections 2023-11-24T06:14:52.422 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.417+0000 7ff094eeb700 1 -- 172.21.15.106:0/1799167690 wait complete. 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 Processor -- start 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 -- start start 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09006c710 0x7ff090142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0900af4d0 0x7ff0901417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.425 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0901f4880 con 0x7ff09015e080 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff090155ec0 con 0x7ff0900af4d0 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.419+0000 7ff094eeb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff090155560 con 0x7ff09006c710 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60198/0 (socket says 172.21.15.106:60198) 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 -- 172.21.15.106:0/1387125511 learned_addr learned my addr 172.21.15.106:0/1387125511 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08e59c700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09006c710 0x7ff090142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08dd9b700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0900af4d0 0x7ff0901417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 -- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09006c710 msgr2=0x7ff090142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09006c710 0x7ff090142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 -- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0900af4d0 msgr2=0x7ff0901417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0900af4d0 0x7ff0901417b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.426 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 -- 172.21.15.106:0/1387125511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0800094a0 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff08ed9d700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff08800cd70 tx=0x7ff08800a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003a20 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088003b80 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0901f45a0 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088004020 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.420+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff090155ae0 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.421+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900753f0 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.422+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff088004180 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.422+0000 7ff07effd700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 0x7ff07006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.422+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff088012070 con 0x7ff09015e080 2023-11-24T06:14:52.427 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.422+0000 7ff08e59c700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 0x7ff07006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.428 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.422+0000 7ff08e59c700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 0x7ff07006d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff084000f60 tx=0x7ff084007c90 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.429 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.426+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff088054ec0 con 0x7ff09015e080 2023-11-24T06:14:52.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.666+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff090156000 con 0x7ff09015e080 2023-11-24T06:14:52.669 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.667+0000 7ff07effd700 1 -- 172.21.15.106:0/1387125511 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7ff0880584e0 con 0x7ff09015e080 2023-11-24T06:14:52.670 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:52.670 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 msgr2=0x7ff07006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 0x7ff07006d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff084000f60 tx=0x7ff084007c90 comp rx=0 tx=0).stop 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 msgr2=0x7ff0901521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff08800cd70 tx=0x7ff08800a570 comp rx=0 tx=0).stop 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 shutdown_connections 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff07006aed0 0x7ff07006d390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff09015e080 0x7ff0901521a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff09006c710 0x7ff090142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.672 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 --2- 172.21.15.106:0/1387125511 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff0900af4d0 0x7ff0901417b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 >> 172.21.15.106:0/1387125511 conn(0x7ff090071b90 msgr2=0x7ff09006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 shutdown_connections 2023-11-24T06:14:52.673 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.669+0000 7ff094eeb700 1 -- 172.21.15.106:0/1387125511 wait complete. 2023-11-24T06:14:52.673 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2023-11-24T06:14:52.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:52.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.801+0000 7efceb65b700 1 Processor -- start 2023-11-24T06:14:52.804 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.801+0000 7efceb65b700 1 -- start start 2023-11-24T06:14:52.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efceb65b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.806 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efceb65b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efce40b2fc0 0x7efce40d3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efceb65b700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce40d2d10 con 0x7efce415dfc0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efceb65b700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce40cefd0 con 0x7efce40b2fc0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efceb65b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce40cf2b0 con 0x7efce40d1570 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efce93f7700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efce415dfc0 0x7efce40d0e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40464/0 (socket says 172.21.15.106:40464) 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efce9bf8700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efce40b2fc0 0x7efce40d3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efce93f7700 1 -- 172.21.15.106:0/1713093718 learned_addr learned my addr 172.21.15.106:0/1713093718 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efce8bf6700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40d34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efcdbfff700 1 -- 172.21.15.106:0/1713093718 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1695945016 0 0) 0x7efce40d2d10 con 0x7efce415dfc0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.802+0000 7efcdbfff700 1 -- 172.21.15.106:0/1713093718 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcd00035b0 con 0x7efce415dfc0 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efce9bf8700 1 -- 172.21.15.106:0/1713093718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 msgr2=0x7efce40d34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:52.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efce9bf8700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40d34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efce9bf8700 1 -- 172.21.15.106:0/1713093718 >> v1:172.21.15.106:6789/0 conn(0x7efce415dfc0 legacy=0x7efce40d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efce9bf8700 1 -- 172.21.15.106:0/1713093718 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40d2fb0 con 0x7efce40b2fc0 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efce9bf8700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce40d3a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009d90 tx=0x7efcdc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2ef3fb2a6db1d8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efcdbfff700 1 -- 172.21.15.106:0/1713093718 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc00e070 con 0x7efce40b2fc0 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efcdbfff700 1 -- 172.21.15.106:0/1713093718 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc00bb20 con 0x7efce40b2fc0 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efcdbfff700 1 -- 172.21.15.106:0/1713093718 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc012430 con 0x7efce40b2fc0 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 -- 172.21.15.106:0/1713093718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 msgr2=0x7efce40d3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce40d3a10 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efcdc009d90 tx=0x7efcdc00b330 comp rx=0 tx=0).stop 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 -- 172.21.15.106:0/1713093718 shutdown_connections 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce40d3a10 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 --2- 172.21.15.106:0/1713093718 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.808 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.803+0000 7efceb65b700 1 -- 172.21.15.106:0/1713093718 >> 172.21.15.106:0/1713093718 conn(0x7efce406b410 msgr2=0x7efce406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:52.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.804+0000 7efceb65b700 1 -- 172.21.15.106:0/1713093718 shutdown_connections 2023-11-24T06:14:52.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.804+0000 7efceb65b700 1 -- 172.21.15.106:0/1713093718 wait complete. 2023-11-24T06:14:52.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 Processor -- start 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 -- start start 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 0x7efce40b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40c8b20 con 0x7efce40b2fc0 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40c7fa0 con 0x7efce415dfc0 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.805+0000 7efceb65b700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce40c8280 con 0x7efce40d1570 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60210/0 (socket says 172.21.15.106:60210) 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 -- 172.21.15.106:0/871014139 learned_addr learned my addr 172.21.15.106:0/871014139 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:52.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce8bf6700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce9bf8700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 0x7efce40b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 -- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 msgr2=0x7efce40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 -- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 msgr2=0x7efce40b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 0x7efce40b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 -- 172.21.15.106:0/871014139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009a70 con 0x7efce40b2fc0 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce8bf6700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce9bf8700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 0x7efce40b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efce93f7700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efcd4001eb0 tx=0x7efcd400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4005d70 con 0x7efce40b2fc0 2023-11-24T06:14:52.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd40070d0 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce40c8560 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd4007460 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.806+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce40ca850 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.807+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce4067f60 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.808+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcd40075c0 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.808+0000 7efcd9ffb700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 0x7efcc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.808+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcd4088a90 con 0x7efce40b2fc0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.808+0000 7efce8bf6700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 0x7efcc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:52.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.808+0000 7efce8bf6700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 0x7efcc806d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efce0009a00 tx=0x7efce0008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:52.815 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:52.813+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcd4053bd0 con 0x7efce40b2fc0 2023-11-24T06:14:53.007 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.005+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efce40ced10 con 0x7efce40b2fc0 2023-11-24T06:14:53.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.006+0000 7efcd9ffb700 1 -- 172.21.15.106:0/871014139 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7efcd4017090 con 0x7efce40b2fc0 2023-11-24T06:14:53.009 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:53.009 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 msgr2=0x7efcc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 0x7efcc806d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efce0009a00 tx=0x7efce0008040 comp rx=0 tx=0).stop 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 msgr2=0x7efce415a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7efcd4001eb0 tx=0x7efcd400c860 comp rx=0 tx=0).stop 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 shutdown_connections 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7efcc806aed0 0x7efcc806d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7efce415dfc0 0x7efce40b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efce40b2fc0 0x7efce415a660 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 --2- 172.21.15.106:0/871014139 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7efce40d1570 0x7efce40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 >> 172.21.15.106:0/871014139 conn(0x7efce406b410 msgr2=0x7efce40d45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 shutdown_connections 2023-11-24T06:14:53.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.008+0000 7efceb65b700 1 -- 172.21.15.106:0/871014139 wait complete. 2023-11-24T06:14:53.023 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:14:53.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:53.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.140+0000 7f81e1017700 1 Processor -- start 2023-11-24T06:14:53.143 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.140+0000 7f81e1017700 1 -- start start 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.141+0000 7f81e1017700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 0x7f81dc06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.141+0000 7f81e1017700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.141+0000 7f81e1017700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc06e7f0 con 0x7f81dc073f90 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.141+0000 7f81e1017700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc06dec0 con 0x7f81dc0ce090 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.141+0000 7f81e1017700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc06e1a0 con 0x7f81dc15e2a0 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 0x7f81dc06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81da59c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81da59c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:40458/0 (socket says 172.21.15.106:40458) 2023-11-24T06:14:53.146 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81da59c700 1 -- 172.21.15.106:0/1959762827 learned_addr learned my addr 172.21.15.106:0/1959762827 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81db59e700 1 --1- 172.21.15.106:0/1959762827 >> v1:172.21.15.176:6789/0 conn(0x7f81dc073f90 0x7f81dc0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:34724/0 (socket says 172.21.15.106:34724) 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 -- 172.21.15.106:0/1959762827 >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 msgr2=0x7f81dc06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1959762827 >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 -- 172.21.15.106:0/1959762827 >> v1:172.21.15.176:6789/0 conn(0x7f81dc073f90 legacy=0x7f81dc0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 -- 172.21.15.106:0/1959762827 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc06e480 con 0x7f81dc15e2a0 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81d9d9b700 1 -- 172.21.15.106:0/1959762827 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006890205 0 0) 0x7f81dc06e7f0 con 0x7f81dc073f90 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81da59c700 1 --2- 172.21.15.106:0/1959762827 >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1959762827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 0x7f81dc06ba70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009840 tx=0x7f81d0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d4685c42cff2ce server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81d9d9b700 1 -- 172.21.15.106:0/1959762827 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0011830 con 0x7f81dc15e2a0 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81d9d9b700 1 -- 172.21.15.106:0/1959762827 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0011990 con 0x7f81dc15e2a0 2023-11-24T06:14:53.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.142+0000 7f81d9d9b700 1 -- 172.21.15.106:0/1959762827 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0011d20 con 0x7f81dc15e2a0 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 -- 172.21.15.106:0/1959762827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 msgr2=0x7f81dc06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 --2- 172.21.15.106:0/1959762827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 0x7f81dc06ba70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009840 tx=0x7f81d0009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 -- 172.21.15.106:0/1959762827 shutdown_connections 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 --2- 172.21.15.106:0/1959762827 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc15e2a0 0x7f81dc06ba70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 --2- 172.21.15.106:0/1959762827 >> v2:172.21.15.176:3300/0 conn(0x7f81dc0ce090 0x7f81dc06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 -- 172.21.15.106:0/1959762827 >> 172.21.15.106:0/1959762827 conn(0x7f81dc0cd570 msgr2=0x7f81dc0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 -- 172.21.15.106:0/1959762827 shutdown_connections 2023-11-24T06:14:53.148 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.143+0000 7f81e1017700 1 -- 172.21.15.106:0/1959762827 wait complete. 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.144+0000 7f81e1017700 1 Processor -- start 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.144+0000 7f81e1017700 1 -- start start 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 0x7f81dc14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81dc15e2a0 0x7f81dc15fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15f8f0 con 0x7f81dc0ce090 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc0af740 con 0x7f81dc15e2a0 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81e1017700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15ece0 con 0x7f81dc073f90 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81da59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81da59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60222/0 (socket says 172.21.15.106:60222) 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.145+0000 7f81da59c700 1 -- 172.21.15.106:0/1857813008 learned_addr learned my addr 172.21.15.106:0/1857813008 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 0x7f81dc14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 -- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 msgr2=0x7f81dc14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 0x7f81dc14f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 -- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81dc15e2a0 msgr2=0x7f81dc15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81dc15e2a0 0x7f81dc15fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 -- 172.21.15.106:0/1857813008 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc009550 con 0x7f81dc0ce090 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 0x7f81dc14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81da59c700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00ebe0 tx=0x7f81cc009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00c8b0 con 0x7f81dc0ce090 2023-11-24T06:14:53.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc00ca10 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d00094a0 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc00cd80 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.146+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc15f2a0 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.147+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc0716c0 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.147+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f81cc013470 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.148+0000 7f81c37fe700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 0x7f81c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.148+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81cc0896b0 con 0x7f81dc0ce090 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.148+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 0x7f81c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.148+0000 7f81dad9d700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 0x7f81c806d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009b90 tx=0x7f81d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.155 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.152+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81cc0547f0 con 0x7f81dc0ce090 2023-11-24T06:14:53.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.383+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81dc067f60 con 0x7f81dc0ce090 2023-11-24T06:14:53.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.384+0000 7f81c37fe700 1 -- 172.21.15.106:0/1857813008 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7f81cc057e10 con 0x7f81dc0ce090 2023-11-24T06:14:53.387 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:53.387 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 msgr2=0x7f81c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 0x7f81c806d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009b90 tx=0x7f81d0008030 comp rx=0 tx=0).stop 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 msgr2=0x7f81dc0af200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f81cc00ebe0 tx=0x7f81cc009e70 comp rx=0 tx=0).stop 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 shutdown_connections 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f81c806aed0 0x7f81c806d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f81dc15e2a0 0x7f81dc15fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f81dc073f90 0x7f81dc14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.389 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 --2- 172.21.15.106:0/1857813008 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81dc0ce090 0x7f81dc0af200 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 >> 172.21.15.106:0/1857813008 conn(0x7f81dc0cd570 msgr2=0x7f81dc15d920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 shutdown_connections 2023-11-24T06:14:53.390 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.386+0000 7f81e1017700 1 -- 172.21.15.106:0/1857813008 wait complete. 2023-11-24T06:14:53.390 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2023-11-24T06:14:53.401 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:14:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.518+0000 7fe307c59700 1 Processor -- start 2023-11-24T06:14:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.518+0000 7fe307c59700 1 -- start start 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.519+0000 7fe307c59700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe30015dfc0 0x7fe3000d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.519+0000 7fe307c59700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000d13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.519+0000 7fe307c59700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3000d2d10 con 0x7fe3000b2a70 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.519+0000 7fe307c59700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3000cefd0 con 0x7fe30015dfc0 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.519+0000 7fe307c59700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000cf2b0 con 0x7fe3000b2fc0 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe30015dfc0 0x7fe3000d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3051f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000d13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3061f6700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fe3000b2a70 0x7fe300161b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:34738/0 (socket says 172.21.15.106:34738) 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fe30015dfc0 0x7fe3000d0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:40468/0 (socket says 172.21.15.106:40468) 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 -- 172.21.15.106:0/3703303520 learned_addr learned my addr 172.21.15.106:0/3703303520 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3051f4700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000d13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:42454/0 (socket says 172.21.15.106:42454) 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 -- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 msgr2=0x7fe3000d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 --2- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000d13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 -- 172.21.15.106:0/3703303520 >> v1:172.21.15.176:6789/0 conn(0x7fe3000b2a70 legacy=0x7fe300161b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 -- 172.21.15.106:0/3703303520 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3000d2fb0 con 0x7fe30015dfc0 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3059f5700 1 --2- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe30015dfc0 0x7fe3000d0e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098f0 tx=0x7fe2f0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e274f1614d562376 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3049f3700 1 -- 172.21.15.106:0/3703303520 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0011830 con 0x7fe30015dfc0 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3049f3700 1 -- 172.21.15.106:0/3703303520 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f0011990 con 0x7fe30015dfc0 2023-11-24T06:14:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.520+0000 7fe3049f3700 1 -- 172.21.15.106:0/3703303520 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f0011d20 con 0x7fe30015dfc0 2023-11-24T06:14:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 -- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe30015dfc0 msgr2=0x7fe3000d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 --2- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe30015dfc0 0x7fe3000d0e60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe2f00098f0 tx=0x7fe2f0009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 -- 172.21.15.106:0/3703303520 shutdown_connections 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 --2- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe30015dfc0 0x7fe3000d0e60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 --2- 172.21.15.106:0/3703303520 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000d13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 -- 172.21.15.106:0/3703303520 >> 172.21.15.106:0/3703303520 conn(0x7fe30006b410 msgr2=0x7fe30006b820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 -- 172.21.15.106:0/3703303520 shutdown_connections 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.521+0000 7fe307c59700 1 -- 172.21.15.106:0/3703303520 wait complete. 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.522+0000 7fe307c59700 1 Processor -- start 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.522+0000 7fe307c59700 1 -- start start 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000b2a70 0x7fe3001523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe300152920 con 0x7fe30015dfc0 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000c7e90 con 0x7fe3000b2a70 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe307c59700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3000c8170 con 0x7fe3000b2fc0 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3059f5700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000b2a70 0x7fe3001523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60240/0 (socket says 172.21.15.106:60240) 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 -- 172.21.15.106:0/223214044 learned_addr learned my addr 172.21.15.106:0/223214044 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3051f4700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 -- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 msgr2=0x7fe3000c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 -- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000b2a70 msgr2=0x7fe3001523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000b2a70 0x7fe3001523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.523+0000 7fe3061f6700 1 -- 172.21.15.106:0/223214044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2f0009550 con 0x7fe30015dfc0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe3061f6700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cbc0 tx=0x7fe2f800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f800a9e0 con 0x7fe30015dfc0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f800ab40 con 0x7fe30015dfc0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8007070 con 0x7fe30015dfc0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3000c8450 con 0x7fe30015dfc0 2023-11-24T06:14:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.524+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3000c8a10 con 0x7fe30015dfc0 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.525+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3000c8d80 con 0x7fe30015dfc0 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.525+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe2f80071d0 con 0x7fe30015dfc0 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.525+0000 7fe2f67fc700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 0x7fe2e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.526+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2f80890f0 con 0x7fe30015dfc0 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.526+0000 7fe3059f5700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 0x7fe2e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.526+0000 7fe3059f5700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 0x7fe2e406d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009c40 tx=0x7fe2f0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.530+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe2f80542e0 con 0x7fe30015dfc0 2023-11-24T06:14:53.763 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.761+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe300067f60 con 0x7fe30015dfc0 2023-11-24T06:14:53.764 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.761+0000 7fe2f67fc700 1 -- 172.21.15.106:0/223214044 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4925 (secure 0 0 0) 0x7fe2f8057900 con 0x7fe30015dfc0 2023-11-24T06:14:53.764 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:53.764 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-24T06:14:35.950673+0000","modified":"2023-11-24T06:14:39.291793+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5088},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5088":{"gid":5088,"name":"b","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.176:6835/2432507264","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":2432507264},{"type":"v1","addr":"172.21.15.176:6835","nonce":2432507264}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-24T06:14:53.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 msgr2=0x7fe2e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.766 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 0x7fe2e406d390 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe2f0009c40 tx=0x7fe2f0008030 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 msgr2=0x7fe3000cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800cbc0 tx=0x7fe2f800ced0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 shutdown_connections 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fe2e406aed0 0x7fe2e406d390 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe30015dfc0 0x7fe3000cc8c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fe3000b2a70 0x7fe3001523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 --2- 172.21.15.106:0/223214044 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fe3000b2fc0 0x7fe3000c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.763+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 >> 172.21.15.106:0/223214044 conn(0x7fe30006b410 msgr2=0x7fe3000d4390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.764+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 shutdown_connections 2023-11-24T06:14:53.767 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.764+0000 7fe307c59700 1 -- 172.21.15.106:0/223214044 wait complete. 2023-11-24T06:14:53.768 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 18 2023-11-24T06:14:53.778 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.895+0000 7f877f9f1700 1 Processor -- start 2023-11-24T06:14:53.898 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 -- start start 2023-11-24T06:14:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 0x7f87780b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f877806c710 0x7f87780afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87780ae430 con 0x7f87780af4d0 2023-11-24T06:14:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780af0b0 con 0x7f877806c710 2023-11-24T06:14:53.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.896+0000 7f877f9f1700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780b05a0 con 0x7f877815e080 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877cf8c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f87780af4d0 0x7f877806c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40506/0 (socket says 172.21.15.106:40506) 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f877806c710 0x7f87780afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877cf8c700 1 -- 172.21.15.106:0/1849469072 learned_addr learned my addr 172.21.15.106:0/1849469072 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f876ffff700 1 -- 172.21.15.106:0/1849469072 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736479255 0 0) 0x7f87780ae430 con 0x7f87780af4d0 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f876ffff700 1 -- 172.21.15.106:0/1849469072 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87640035b0 con 0x7f87780af4d0 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877d78d700 1 --2- 172.21.15.106:0/1849469072 >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 0x7f87780b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 -- 172.21.15.106:0/1849469072 >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 msgr2=0x7f87780b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 --2- 172.21.15.106:0/1849469072 >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 0x7f87780b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 -- 172.21.15.106:0/1849469072 >> v1:172.21.15.106:6789/0 conn(0x7f87780af4d0 legacy=0x7f877806c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.902 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 -- 172.21.15.106:0/1849469072 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87780ae710 con 0x7f877806c710 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877d78d700 1 --2- 172.21.15.106:0/1849469072 >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 0x7f87780b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f877df8e700 1 --2- 172.21.15.106:0/1849469072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877806c710 0x7f87780afb90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8778072a90 tx=0x7f877000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d36996082466faa server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f876ffff700 1 -- 172.21.15.106:0/1849469072 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000e070 con 0x7f877806c710 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f876ffff700 1 -- 172.21.15.106:0/1849469072 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877000bae0 con 0x7f877806c710 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.897+0000 7f876ffff700 1 -- 172.21.15.106:0/1849469072 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877000be90 con 0x7f877806c710 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 -- 172.21.15.106:0/1849469072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877806c710 msgr2=0x7f87780afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 --2- 172.21.15.106:0/1849469072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877806c710 0x7f87780afb90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8778072a90 tx=0x7f877000b330 comp rx=0 tx=0).stop 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 -- 172.21.15.106:0/1849469072 shutdown_connections 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 --2- 172.21.15.106:0/1849469072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f877806c710 0x7f87780afb90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.903 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 --2- 172.21.15.106:0/1849469072 >> v2:172.21.15.176:3300/0 conn(0x7f877815e080 0x7f87780b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 -- 172.21.15.106:0/1849469072 >> 172.21.15.106:0/1849469072 conn(0x7f8778071b90 msgr2=0x7f8778071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 -- 172.21.15.106:0/1849469072 shutdown_connections 2023-11-24T06:14:53.904 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.898+0000 7f877f9f1700 1 -- 172.21.15.106:0/1849469072 wait complete. 2023-11-24T06:14:53.906 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.899+0000 7f877f9f1700 1 Processor -- start 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.899+0000 7f877f9f1700 1 -- start start 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f877806c710 0x7f8778154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f877815e080 0x7f87780b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877813fc90 con 0x7f87780af4d0 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877815f150 con 0x7f877815e080 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877815f430 con 0x7f877806c710 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60252/0 (socket says 172.21.15.106:60252) 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 -- 172.21.15.106:0/2527974224 learned_addr learned my addr 172.21.15.106:0/2527974224 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877df8e700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f877815e080 0x7f87780b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.907 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877d78d700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f877806c710 0x7f8778154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 -- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f877806c710 msgr2=0x7f8778154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f877806c710 0x7f8778154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 -- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f877815e080 msgr2=0x7f87780b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f877815e080 0x7f87780b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 -- 172.21.15.106:0/2527974224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8770009a70 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877cf8c700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8768005910 tx=0x7f876800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768005d70 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87680070d0 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877815f710 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.900+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768007440 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.901+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877815fcd0 con 0x7f87780af4d0 2023-11-24T06:14:53.908 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.901+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87780753f0 con 0x7f87780af4d0 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.902+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87680075a0 con 0x7f87780af4d0 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.902+0000 7f876dffb700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 0x7f875c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.902+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8768088a10 con 0x7f87780af4d0 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.902+0000 7f877d78d700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 0x7f875c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.903+0000 7f877d78d700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 0x7f875c06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8774006fd0 tx=0x7f8774008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:53.909 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:53.906+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8768053ae0 con 0x7f87780af4d0 2023-11-24T06:14:54.105 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.103+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87780d09b0 con 0x7f87780af4d0 2023-11-24T06:14:54.106 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.104+0000 7f876dffb700 1 -- 172.21.15.106:0/2527974224 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16593 (secure 0 0 0) 0x7f8768080e60 con 0x7f87780af4d0 2023-11-24T06:14:54.106 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:54.107 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":33,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:37.558825+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-24T06:14:33.757193+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-24T06:14:34.919394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 msgr2=0x7f875c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 0x7f875c06d390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8774006fd0 tx=0x7f8774008040 comp rx=0 tx=0).stop 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 msgr2=0x7f87780b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f8768005910 tx=0x7f876800c9e0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 shutdown_connections 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f875c06aed0 0x7f875c06d390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f877815e080 0x7f87780b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.109 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f877806c710 0x7f8778154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 --2- 172.21.15.106:0/2527974224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87780af4d0 0x7f87780b4340 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 >> 172.21.15.106:0/2527974224 conn(0x7f8778071b90 msgr2=0x7f877815c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 shutdown_connections 2023-11-24T06:14:54.110 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.106+0000 7f877f9f1700 1 -- 172.21.15.106:0/2527974224 wait complete. 2023-11-24T06:14:54.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-24T06:14:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.240+0000 7f7a15a47700 1 Processor -- start 2023-11-24T06:14:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.240+0000 7f7a15a47700 1 -- start start 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a15a47700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a1015e080 0x7f7a100b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a15a47700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100ae430 con 0x7f7a1006c710 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a15a47700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a100ae710 con 0x7f7a100af4d0 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a15a47700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a100af0b0 con 0x7f7a1015e080 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a0effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a1015e080 0x7f7a100b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a0effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a1015e080 0x7f7a100b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60258/0 (socket says 172.21.15.106:60258) 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a0f7fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a1006c710 0x7f7a1006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40524/0 (socket says 172.21.15.106:40524) 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.241+0000 7f7a0effd700 1 -- 172.21.15.106:0/833168855 learned_addr learned my addr 172.21.15.106:0/833168855 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0effd700 1 -- 172.21.15.106:0/833168855 >> v1:172.21.15.176:6789/0 conn(0x7f7a100af4d0 legacy=0x7f7a1006c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0effd700 1 -- 172.21.15.106:0/833168855 >> v1:172.21.15.106:6789/0 conn(0x7f7a1006c710 legacy=0x7f7a1006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0effd700 1 -- 172.21.15.106:0/833168855 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a100ae9f0 con 0x7f7a1015e080 2023-11-24T06:14:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0effd700 1 --2- 172.21.15.106:0/833168855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1015e080 0x7f7a100b5050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098f0 tx=0x7f7a04009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f195043996406f0f server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0dffb700 1 -- 172.21.15.106:0/833168855 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400b8a0 con 0x7f7a1015e080 2023-11-24T06:14:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0dffb700 1 -- 172.21.15.106:0/833168855 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0400ba00 con 0x7f7a1015e080 2023-11-24T06:14:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.242+0000 7f7a0dffb700 1 -- 172.21.15.106:0/833168855 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0400bd90 con 0x7f7a1015e080 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 -- 172.21.15.106:0/833168855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1015e080 msgr2=0x7f7a100b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 --2- 172.21.15.106:0/833168855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1015e080 0x7f7a100b5050 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a040098f0 tx=0x7f7a04009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 -- 172.21.15.106:0/833168855 shutdown_connections 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 --2- 172.21.15.106:0/833168855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a1015e080 0x7f7a100b5050 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 -- 172.21.15.106:0/833168855 >> 172.21.15.106:0/833168855 conn(0x7f7a10071b90 msgr2=0x7f7a10071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 -- 172.21.15.106:0/833168855 shutdown_connections 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.243+0000 7f7a15a47700 1 -- 172.21.15.106:0/833168855 wait complete. 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.244+0000 7f7a15a47700 1 Processor -- start 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.244+0000 7f7a15a47700 1 -- start start 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a1006c710 0x7f7a10154970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a1015e080 0x7f7a101f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101577f0 con 0x7f7a100af4d0 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101574e0 con 0x7f7a1006c710 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a101551c0 con 0x7f7a1015e080 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60266/0 (socket says 172.21.15.106:60266) 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 -- 172.21.15.106:0/1173959329 learned_addr learned my addr 172.21.15.106:0/1173959329 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0effd700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a1006c710 0x7f7a10154970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0f7fe700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a1015e080 0x7f7a101f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 -- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a1015e080 msgr2=0x7f7a101f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a1015e080 0x7f7a101f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 -- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a1006c710 msgr2=0x7f7a10154970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.250 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a1006c710 0x7f7a10154970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 -- 172.21.15.106:0/1173959329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a04009550 con 0x7f7a100af4d0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a0e7fc700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c4b0 tx=0x7f7a0000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000052d0 con 0x7f7a100af4d0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a00005430 con 0x7f7a100af4d0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a101554a0 con 0x7f7a100af4d0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.245+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a000038c0 con 0x7f7a100af4d0 2023-11-24T06:14:54.251 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.246+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a10154eb0 con 0x7f7a100af4d0 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.247+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a100753f0 con 0x7f7a100af4d0 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.247+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7a00003a20 con 0x7f7a100af4d0 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.247+0000 7f79f7fff700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 0x7f79fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.247+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a00088a90 con 0x7f7a100af4d0 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.247+0000 7f7a0effd700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 0x7f79fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.252 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.248+0000 7f7a0effd700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 0x7f79fc06d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7a04014040 tx=0x7f7a04008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.254 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.252+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7a00053b40 con 0x7f7a100af4d0 2023-11-24T06:14:54.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.487+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f7a10067f60 con 0x7f7a100af4d0 2023-11-24T06:14:54.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2023-11-24T06:14:54.487+0000 7f20eeb57700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-24T06:14:54.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.489+0000 7f79f7fff700 1 -- 172.21.15.106:0/1173959329 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7f7a00017090 con 0x7f7a100af4d0 2023-11-24T06:14:54.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.491+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 msgr2=0x7f79fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.491+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 0x7f79fc06d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7a04014040 tx=0x7f7a04008030 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.491+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 msgr2=0x7f7a10150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.491+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7a0000c4b0 tx=0x7f7a0000c870 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.491+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 shutdown_connections 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f79fc06aed0 0x7f79fc06d390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f7a1015e080 0x7f7a101f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f7a1006c710 0x7f7a10154970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 --2- 172.21.15.106:0/1173959329 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a100af4d0 0x7f7a10150ca0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 >> 172.21.15.106:0/1173959329 conn(0x7f7a10071b90 msgr2=0x7f7a1006f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 shutdown_connections 2023-11-24T06:14:54.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.492+0000 7f7a15a47700 1 -- 172.21.15.106:0/1173959329 wait complete. 2023-11-24T06:14:54.496 INFO:teuthology.orchestra.run.smithi106.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-24T06:14:54.497 INFO:tasks.ceph.mds.b.smithi176.stderr: -3195> 2023-11-24T06:14:39.424+0000 7f501c370700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-24T06:14:54.508 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-24T06:14:54.527 INFO:tasks.ceph.mds.b.smithi176.stdout:starting mds.b at 2023-11-24T06:14:54.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.627+0000 7f1b42cb7700 1 Processor -- start 2023-11-24T06:14:54.630 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.627+0000 7f1b42cb7700 1 -- start start 2023-11-24T06:14:54.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b42cb7700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b3c1587f0 0x7f1b3c06aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b42cb7700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f1b3c0b4370 0x7f1b3c15b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b42cb7700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c06b530 con 0x7f1b3c15b370 2023-11-24T06:14:54.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b42cb7700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0ae5e0 con 0x7f1b3c1587f0 2023-11-24T06:14:54.632 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b42cb7700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c15be30 con 0x7f1b3c0b4370 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b3c1587f0 0x7f1b3c06aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b3bfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1b3c15b370 0x7f1b3c0b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40536/0 (socket says 172.21.15.106:40536) 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b3bfff700 1 -- 172.21.15.106:0/3212607029 learned_addr learned my addr 172.21.15.106:0/3212607029 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b41254700 1 --2- 172.21.15.106:0/3212607029 >> v2:172.21.15.176:3300/0 conn(0x7f1b3c0b4370 0x7f1b3c15b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 -- 172.21.15.106:0/3212607029 >> v2:172.21.15.176:3300/0 conn(0x7f1b3c0b4370 msgr2=0x7f1b3c15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 --2- 172.21.15.106:0/3212607029 >> v2:172.21.15.176:3300/0 conn(0x7f1b3c0b4370 0x7f1b3c15b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 -- 172.21.15.106:0/3212607029 >> v1:172.21.15.106:6789/0 conn(0x7f1b3c15b370 legacy=0x7f1b3c0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 -- 172.21.15.106:0/3212607029 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c15c110 con 0x7f1b3c1587f0 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b3b7fe700 1 -- 172.21.15.106:0/3212607029 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2812797363 0 0) 0x7f1b3c06b530 con 0x7f1b3c15b370 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.628+0000 7f1b40a53700 1 --2- 172.21.15.106:0/3212607029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c1587f0 0x7f1b3c06aff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009840 tx=0x7f1b30009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245cf41413c57261 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b3b7fe700 1 -- 172.21.15.106:0/3212607029 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011830 con 0x7f1b3c1587f0 2023-11-24T06:14:54.633 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b3b7fe700 1 -- 172.21.15.106:0/3212607029 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30011990 con 0x7f1b3c1587f0 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b3b7fe700 1 -- 172.21.15.106:0/3212607029 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011d20 con 0x7f1b3c1587f0 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 -- 172.21.15.106:0/3212607029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c1587f0 msgr2=0x7f1b3c06aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/3212607029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c1587f0 0x7f1b3c06aff0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009840 tx=0x7f1b30009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 -- 172.21.15.106:0/3212607029 shutdown_connections 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/3212607029 >> v2:172.21.15.176:3300/0 conn(0x7f1b3c0b4370 0x7f1b3c15b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/3212607029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c1587f0 0x7f1b3c06aff0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 -- 172.21.15.106:0/3212607029 >> 172.21.15.106:0/3212607029 conn(0x7f1b3c0d0bf0 msgr2=0x7f1b3c0d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 -- 172.21.15.106:0/3212607029 shutdown_connections 2023-11-24T06:14:54.634 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.629+0000 7f1b42cb7700 1 -- 172.21.15.106:0/3212607029 wait complete. 2023-11-24T06:14:54.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.630+0000 7f1b42cb7700 1 Processor -- start 2023-11-24T06:14:54.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.630+0000 7f1b42cb7700 1 -- start start 2023-11-24T06:14:54.637 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b3c0b4370 0x7f1b3c14c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b3c1587f0 0x7f1b3c0af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b02a0 con 0x7f1b3c15b370 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b0580 con 0x7f1b3c0b4370 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b42cb7700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c0b0860 con 0x7f1b3c1587f0 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b41254700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b41254700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60282/0 (socket says 172.21.15.106:60282) 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b41254700 1 -- 172.21.15.106:0/4127280857 learned_addr learned my addr 172.21.15.106:0/4127280857 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.631+0000 7f1b3bfff700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b3c1587f0 0x7f1b3c0af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b40a53700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b3c0b4370 0x7f1b3c14c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 -- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b3c1587f0 msgr2=0x7f1b3c0af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.638 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b3c1587f0 0x7f1b3c0af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 -- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b3c0b4370 msgr2=0x7f1b3c14c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b3c0b4370 0x7f1b3c14c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 -- 172.21.15.106:0/4127280857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b300094a0 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b41254700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1b34007e40 tx=0x7f1b3400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400ed30 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b34014420 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c0b0b40 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b340147d0 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.632+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c14cb70 con 0x7f1b3c15b370 2023-11-24T06:14:54.639 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.633+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c14cd30 con 0x7f1b3c15b370 2023-11-24T06:14:54.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.634+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1b34014930 con 0x7f1b3c15b370 2023-11-24T06:14:54.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.634+0000 7f1b397fa700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 0x7f1b2006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:54.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.634+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f1b34089cb0 con 0x7f1b3c15b370 2023-11-24T06:14:54.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.634+0000 7f1b40a53700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 0x7f1b2006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:54.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.634+0000 7f1b40a53700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 0x7f1b2006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b300090b0 tx=0x7f1b30008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:54.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.638+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1b34054d00 con 0x7f1b3c15b370 2023-11-24T06:14:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:54.873+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b3c0b03e0 con 0x7f1b3c15b370 2023-11-24T06:14:55.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.490+0000 7f1b397fa700 1 -- 172.21.15.106:0/4127280857 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1b3c0b03e0 con 0x7f1b3c15b370 2023-11-24T06:14:55.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.492+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 msgr2=0x7f1b2006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 0x7f1b2006d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1b300090b0 tx=0x7f1b30008030 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 msgr2=0x7f1b3c15c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1b34007e40 tx=0x7f1b3400e3c0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 shutdown_connections 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1b2006aed0 0x7f1b2006d390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b3c15b370 0x7f1b3c15c510 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1b3c0b4370 0x7f1b3c14c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 --2- 172.21.15.106:0/4127280857 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1b3c1587f0 0x7f1b3c0af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 >> 172.21.15.106:0/4127280857 conn(0x7f1b3c0d0bf0 msgr2=0x7f1b3c0745e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:55.496 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 shutdown_connections 2023-11-24T06:14:55.497 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.493+0000 7f1b42cb7700 1 -- 172.21.15.106:0/4127280857 wait complete. 2023-11-24T06:14:55.509 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-24T06:14:55.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.633+0000 7fd474462700 1 Processor -- start 2023-11-24T06:14:55.636 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.633+0000 7fd474462700 1 -- start start 2023-11-24T06:14:55.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd474462700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd46c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.640 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd474462700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0d1e60 con 0x7fd46c15dfe0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd474462700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd46c0d2140 con 0x7fd46c0b5e70 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd474462700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0d2ae0 con 0x7fd46c15e3c0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd4721fe700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd46c15dfe0 0x7fd46c0d3460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40548/0 (socket says 172.21.15.106:40548) 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.634+0000 7fd4721fe700 1 -- 172.21.15.106:0/2359666799 learned_addr learned my addr 172.21.15.106:0/2359666799 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4719fd700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd46c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160447437 0 0) 0x7fd46c0d1e60 con 0x7fd46c15dfe0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4540035b0 con 0x7fd46c15dfe0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166366206 0 0) 0x7fd4540035b0 con 0x7fd46c15dfe0 2023-11-24T06:14:55.641 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 msgr2=0x7fd46c0b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd46c0b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 >> v1:172.21.15.176:6789/0 conn(0x7fd46c0b5e70 legacy=0x7fd46c0b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c0d2420 con 0x7fd46c15dfe0 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fd464001670 con 0x7fd46c15dfe0 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 >> v1:172.21.15.106:6789/0 conn(0x7fd46c15dfe0 legacy=0x7fd46c0d3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd454003a30 0x7fd454003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd454004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.642 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd454004d90 0x7fd454005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0d2ae0 con 0x7fd454003a30 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45400baf0 con 0x7fd454004d90 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd45400bcb0 con 0x7fd46c15e3c0 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd454003a30 0x7fd454003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4719fd700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd454004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4729ff700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd454004d90 0x7fd454005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 -- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 msgr2=0x7fd454004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd46c15e3c0 0x7fd454004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 -- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd454004d90 msgr2=0x7fd454005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd454004d90 0x7fd454005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4721fe700 1 -- 172.21.15.106:0/2359666799 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540035b0 con 0x7fd454003a30 2023-11-24T06:14:55.643 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.635+0000 7fd4729ff700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd454004d90 0x7fd454005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd454003a30 0x7fd454003e50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c210 tx=0x7fd454005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5bdb579fcbcc21 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464007c10 con 0x7fd454003a30 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46400cdb0 con 0x7fd454003a30 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd4711fc700 1 -- 172.21.15.106:0/2359666799 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd464005ba0 con 0x7fd454003a30 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 -- 172.21.15.106:0/2359666799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd454003a30 msgr2=0x7fd454003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 --2- 172.21.15.106:0/2359666799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd454003a30 0x7fd454003e50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd46400c210 tx=0x7fd454005880 comp rx=0 tx=0).stop 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd4729ff700 1 -- 172.21.15.106:0/2359666799 reap_dead start 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 -- 172.21.15.106:0/2359666799 shutdown_connections 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 -- 172.21.15.106:0/2359666799 >> 172.21.15.106:0/2359666799 conn(0x7fd46c0d0b10 msgr2=0x7fd46c0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 -- 172.21.15.106:0/2359666799 shutdown_connections 2023-11-24T06:14:55.644 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.636+0000 7fd474462700 1 -- 172.21.15.106:0/2359666799 wait complete. 2023-11-24T06:14:55.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 Processor -- start 2023-11-24T06:14:55.645 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 -- start start 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd454003a30 0x7fd46c1f6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46c14eeb0 0x7fd46c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c14f870 con 0x7fd46c0cc170 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c0ccb30 con 0x7fd46c14eeb0 2023-11-24T06:14:55.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd474462700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c14e950 con 0x7fd454003a30 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd4729ff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd4729ff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60302/0 (socket says 172.21.15.106:60302) 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.638+0000 7fd4729ff700 1 -- 172.21.15.106:0/2119728984 learned_addr learned my addr 172.21.15.106:0/2119728984 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4719fd700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46c14eeb0 0x7fd46c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd454003a30 0x7fd46c1f6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 -- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd454003a30 msgr2=0x7fd46c1f6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd454003a30 0x7fd46c1f6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 -- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46c14eeb0 msgr2=0x7fd46c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46c14eeb0 0x7fd46c14f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 -- 172.21.15.106:0/2119728984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd46c14fa90 con 0x7fd46c0cc170 2023-11-24T06:14:55.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd4729ff700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd46c08c8e0 tx=0x7fd45c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00eee0 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd45c003c10 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c14fd70 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0050d0 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.639+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c150330 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.640+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c0751e0 con 0x7fd46c0cc170 2023-11-24T06:14:55.649 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.640+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd45c005230 con 0x7fd46c0cc170 2023-11-24T06:14:55.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.641+0000 7fd46affd700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 0x7fd45806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:55.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.641+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fd45c089420 con 0x7fd46c0cc170 2023-11-24T06:14:55.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.641+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 0x7fd45806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:55.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.641+0000 7fd4721fe700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 0x7fd45806d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd464001930 tx=0x7fd464007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:55.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.645+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd45c054500 con 0x7fd46c0cc170 2023-11-24T06:14:55.838 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:55.836+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd46c0caac0 con 0x7fd46c0cc170 2023-11-24T06:14:56.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.495+0000 7fd46affd700 1 -- 172.21.15.106:0/2119728984 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v35) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd45c001b50 con 0x7fd46c0cc170 2023-11-24T06:14:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 msgr2=0x7fd45806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 0x7fd45806d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd464001930 tx=0x7fd464007000 comp rx=0 tx=0).stop 2023-11-24T06:14:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 msgr2=0x7fd46c0cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fd46c08c8e0 tx=0x7fd45c00edc0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 shutdown_connections 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd45806aed0 0x7fd45806d390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd46c0cc170 0x7fd46c0cc5f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd454003a30 0x7fd46c1f6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 --2- 172.21.15.106:0/2119728984 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd46c14eeb0 0x7fd46c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 >> 172.21.15.106:0/2119728984 conn(0x7fd46c0d0b10 msgr2=0x7fd46c15ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 shutdown_connections 2023-11-24T06:14:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.500+0000 7fd474462700 1 -- 172.21.15.106:0/2119728984 wait complete. 2023-11-24T06:14:56.509 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_metadata' removed 2023-11-24T06:14:56.518 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-24T06:14:56.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.644+0000 7f2dd2dec700 1 Processor -- start 2023-11-24T06:14:56.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.644+0000 7f2dd2dec700 1 -- start start 2023-11-24T06:14:56.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dd2dec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dcc0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dd2dec700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc06ee50 con 0x7f2dcc0746a0 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dd2dec700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dcc0b05c0 con 0x7f2dcc0b01e0 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dd2dec700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1470a0 con 0x7f2dcc06e9c0 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dcbfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2dcc0746a0 0x7f2dcc06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40570/0 (socket says 172.21.15.106:40570) 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.645+0000 7f2dcbfff700 1 -- 172.21.15.106:0/1279539021 learned_addr learned my addr 172.21.15.106:0/1279539021 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1983289232 0 0) 0x7f2dcc06ee50 con 0x7f2dcc0746a0 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd1389700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dcc0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dbc0035b0 con 0x7f2dcc0746a0 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3990440346 0 0) 0x7f2dbc0035b0 con 0x7f2dcc0746a0 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 msgr2=0x7f2dcc0b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dcc0b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 >> v1:172.21.15.176:6789/0 conn(0x7f2dcc0b01e0 legacy=0x7f2dcc073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0b4250 con 0x7f2dcc0746a0 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f2db8001670 con 0x7f2dcc0746a0 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd1389700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dcc0b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 >> v1:172.21.15.106:6789/0 conn(0x7f2dcc0746a0 legacy=0x7f2dcc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dbc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dbc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dbc004d90 0x7f2dbc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1470a0 con 0x7f2dbc003a30 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc00bba0 con 0x7f2dbc004d90 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dbc00bd60 con 0x7f2dcc06e9c0 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dbc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd1389700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dbc004d90 0x7f2dbc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dbc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 -- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 msgr2=0x7f2dbc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dbc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 -- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dbc004d90 msgr2=0x7f2dbc005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dbc004d90 0x7f2dbc005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.646+0000 7f2dd0b88700 1 -- 172.21.15.106:0/1279539021 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dbc0035b0 con 0x7f2dbc003a30 2023-11-24T06:14:56.653 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc06e9c0 0x7f2dbc004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dbc003e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00017c0 tx=0x7f2dbc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a9fc724d51e358 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00052d0 con 0x7f2dbc003a30 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc0005430 con 0x7f2dbc003a30 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dcb7fe700 1 -- 172.21.15.106:0/1279539021 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00038c0 con 0x7f2dbc003a30 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 -- 172.21.15.106:0/1279539021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 msgr2=0x7f2dbc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/1279539021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dbc003e50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2dc00017c0 tx=0x7f2dbc005880 comp rx=0 tx=0).stop 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd1389700 1 -- 172.21.15.106:0/1279539021 reap_dead start 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 -- 172.21.15.106:0/1279539021 shutdown_connections 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 -- 172.21.15.106:0/1279539021 >> 172.21.15.106:0/1279539021 conn(0x7f2dcc0d0b40 msgr2=0x7f2dcc0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:56.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 -- 172.21.15.106:0/1279539021 shutdown_connections 2023-11-24T06:14:56.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.647+0000 7f2dd2dec700 1 -- 172.21.15.106:0/1279539021 wait complete. 2023-11-24T06:14:56.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 Processor -- start 2023-11-24T06:14:56.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 -- start start 2023-11-24T06:14:56.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 0x7f2dcc0c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc13fdd0 0x7f2dcc140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0c6550 con 0x7f2dbc003a30 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc1613f0 con 0x7f2dcc0c7490 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.649+0000 7f2dd2dec700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dcc0c5c60 con 0x7f2dcc13fdd0 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60318/0 (socket says 172.21.15.106:60318) 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 -- 172.21.15.106:0/957339147 learned_addr learned my addr 172.21.15.106:0/957339147 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 0x7f2dcc0c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.658 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd1389700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc13fdd0 0x7f2dcc140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 -- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc13fdd0 msgr2=0x7f2dcc140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc13fdd0 0x7f2dcc140280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 -- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 msgr2=0x7f2dcc0c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 0x7f2dcc0c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 -- 172.21.15.106:0/957339147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dcc0c8000 con 0x7f2dbc003a30 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 0x7f2dcc0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd0b88700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc005830 tx=0x7f2dc0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0007450 con 0x7f2dbc003a30 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc00075b0 con 0x7f2dbc003a30 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dcc0c5f00 con 0x7f2dbc003a30 2023-11-24T06:14:56.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc00038c0 con 0x7f2dbc003a30 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.650+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dcc0c69e0 con 0x7f2dbc003a30 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.651+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dcc0c6b70 con 0x7f2dbc003a30 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.651+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dc0003a20 con 0x7f2dbc003a30 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.652+0000 7f2dc97fa700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 0x7f2db006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.652+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2dc008a4b0 con 0x7f2dbc003a30 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.652+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 0x7f2db006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:56.660 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.652+0000 7f2dcbfff700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 0x7f2db006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001eb0 tx=0x7f2db8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:56.661 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.656+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dc0055750 con 0x7f2dbc003a30 2023-11-24T06:14:56.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:56.852+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2dcc067f60 con 0x7f2dbc003a30 2023-11-24T06:14:57.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.497+0000 7f2dc97fa700 1 -- 172.21.15.106:0/957339147 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v36) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2dc0058d70 con 0x7f2dbc003a30 2023-11-24T06:14:57.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 msgr2=0x7f2db006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 0x7f2db006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001eb0 tx=0x7f2db8009040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.503 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 msgr2=0x7f2dcc0b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc005830 tx=0x7f2dc0001120 comp rx=0 tx=0).stop 2023-11-24T06:14:57.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 shutdown_connections 2023-11-24T06:14:57.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2db006aed0 0x7f2db006d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2dcc13fdd0 0x7f2dcc140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dbc003a30 0x7f2dcc0b16e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 --2- 172.21.15.106:0/957339147 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2dcc0c7490 0x7f2dcc0c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 >> 172.21.15.106:0/957339147 conn(0x7f2dcc0d0b40 msgr2=0x7f2dcc06c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 shutdown_connections 2023-11-24T06:14:57.505 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.501+0000 7f2dd2dec700 1 -- 172.21.15.106:0/957339147 wait complete. 2023-11-24T06:14:57.506 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'cephfs_data' removed 2023-11-24T06:14:57.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-11-24T06:14:57.647 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.644+0000 7ff950d77700 1 Processor -- start 2023-11-24T06:14:57.648 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 -- start start 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 0x7ff94c0cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c0b4970 con 0x7ff94c15be20 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c0ce210 con 0x7ff94c0cd840 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.645+0000 7ff950d77700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0cfed0 con 0x7ff94c0b4e00 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff94ad9d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 0x7ff94c0cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.650 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3301/0 says I am v2:172.21.15.106:42548/0 (socket says 172.21.15.106:42548) 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 -- 172.21.15.106:0/2456020383 learned_addr learned my addr 172.21.15.106:0/2456020383 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 -- 172.21.15.106:0/2456020383 >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 msgr2=0x7ff94c0cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 --2- 172.21.15.106:0/2456020383 >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 0x7ff94c0cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 -- 172.21.15.106:0/2456020383 >> v1:172.21.15.176:6789/0 conn(0x7ff94c15be20 legacy=0x7ff94c0af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff949d9b700 1 -- 172.21.15.106:0/2456020383 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c0b4360 con 0x7ff94c0b4e00 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.646+0000 7ff94ad9d700 1 --2- 172.21.15.106:0/2456020383 >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 0x7ff94c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff949d9b700 1 --2- 172.21.15.106:0/2456020383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098f0 tx=0x7ff934009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c60025554f4d929 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff94959a700 1 -- 172.21.15.106:0/2456020383 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011830 con 0x7ff94c0b4e00 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff94959a700 1 -- 172.21.15.106:0/2456020383 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff934011990 con 0x7ff94c0b4e00 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff94959a700 1 -- 172.21.15.106:0/2456020383 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff934011d20 con 0x7ff94c0b4e00 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 -- 172.21.15.106:0/2456020383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 msgr2=0x7ff94c0b5280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 --2- 172.21.15.106:0/2456020383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9340098f0 tx=0x7ff934009c00 comp rx=0 tx=0).stop 2023-11-24T06:14:57.651 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 -- 172.21.15.106:0/2456020383 shutdown_connections 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 --2- 172.21.15.106:0/2456020383 >> v2:172.21.15.176:3300/0 conn(0x7ff94c0cd840 0x7ff94c0cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 --2- 172.21.15.106:0/2456020383 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c0b4e00 0x7ff94c0b5280 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 -- 172.21.15.106:0/2456020383 >> 172.21.15.106:0/2456020383 conn(0x7ff94c0b2050 msgr2=0x7ff94c0b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 -- 172.21.15.106:0/2456020383 shutdown_connections 2023-11-24T06:14:57.652 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.647+0000 7ff950d77700 1 -- 172.21.15.106:0/2456020383 wait complete. 2023-11-24T06:14:57.654 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 Processor -- start 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 -- start start 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94c0b4e00 0x7ff94c0ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c15be20 0x7ff94c15e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0caf40 con 0x7ff94c0cd840 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0cbda0 con 0x7ff94c0b4e00 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.649+0000 7ff950d77700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0ca620 con 0x7ff94c15be20 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60334/0 (socket says 172.21.15.106:60334) 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 -- 172.21.15.106:0/2458894037 learned_addr learned my addr 172.21.15.106:0/2458894037 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff94a59c700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94c0b4e00 0x7ff94c0ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff94ad9d700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c15be20 0x7ff94c15e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.655 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 -- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c15be20 msgr2=0x7ff94c15e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c15be20 0x7ff94c15e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 -- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94c0b4e00 msgr2=0x7ff94c0ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94c0b4e00 0x7ff94c0ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 -- 172.21.15.106:0/2458894037 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440094a0 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff949d9b700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff934014040 tx=0x7ff934004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340044d0 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93401e070 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff934009550 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9340038e0 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.650+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c0cb470 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.651+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c068d90 con 0x7ff94c0cd840 2023-11-24T06:14:57.656 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.652+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff934003a40 con 0x7ff94c0cd840 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.652+0000 7ff942ffd700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 0x7ff92c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.652+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff93408a100 con 0x7ff94c0cd840 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.652+0000 7ff94a59c700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 0x7ff92c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.657 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.653+0000 7ff94a59c700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 0x7ff92c06d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff94c062490 tx=0x7ff93c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.659 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.657+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff934055540 con 0x7ff94c0cd840 2023-11-24T06:14:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.850+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff94c062920 con 0x7ff94c0cd840 2023-11-24T06:14:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.853+0000 7ff942ffd700 1 -- 172.21.15.106:0/2458894037 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff934058b60 con 0x7ff94c0cd840 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 msgr2=0x7ff92c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 0x7ff92c06d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff94c062490 tx=0x7ff93c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 msgr2=0x7ff94c14cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7ff934014040 tx=0x7ff934004750 comp rx=0 tx=0).stop 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 shutdown_connections 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff92c06aed0 0x7ff92c06d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff94c15be20 0x7ff94c15e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff94c0b4e00 0x7ff94c0ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 --2- 172.21.15.106:0/2458894037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff94c0cd840 0x7ff94c14cf70 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 >> 172.21.15.106:0/2458894037 conn(0x7ff94c0b2050 msgr2=0x7ff94c15c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 shutdown_connections 2023-11-24T06:14:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.855+0000 7ff950d77700 1 -- 172.21.15.106:0/2458894037 wait complete. 2023-11-24T06:14:57.870 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-11-24T06:14:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 Processor -- start 2023-11-24T06:14:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 -- start start 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a40d3610 0x7f55a40b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40b5e90 0x7f55a40b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a40d2810 con 0x7f55a415e480 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a40b6300 con 0x7f55a40d3610 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.988+0000 7f55a92ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a40d2a70 con 0x7f55a40b5e90 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a40d3610 0x7f55a40b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.993 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a2ffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f55a415e480 0x7f55a40d2100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40602/0 (socket says 172.21.15.106:40602) 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f55a40d3610 0x7f55a40b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60342/0 (socket says 172.21.15.106:60342) 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a2ffd700 1 -- 172.21.15.106:0/1632314537 learned_addr learned my addr 172.21.15.106:0/1632314537 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a37fe700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40b5e90 0x7f55a40b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 -- 172.21.15.106:0/1632314537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40b5e90 msgr2=0x7f55a40b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40b5e90 0x7f55a40b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 -- 172.21.15.106:0/1632314537 >> v1:172.21.15.106:6789/0 conn(0x7f55a415e480 legacy=0x7f55a40d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a1ffb700 1 -- 172.21.15.106:0/1632314537 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064870736 0 0) 0x7f55a40d2810 con 0x7f55a415e480 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 -- 172.21.15.106:0/1632314537 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a40d2d50 con 0x7f55a40d3610 2023-11-24T06:14:57.994 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a27fc700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40d3610 0x7f55a40b5950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5594009840 tx=0x7f5594009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b3f00cf1e0a70 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a1ffb700 1 -- 172.21.15.106:0/1632314537 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594011830 con 0x7f55a40d3610 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a1ffb700 1 -- 172.21.15.106:0/1632314537 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5594011990 con 0x7f55a40d3610 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.989+0000 7f55a1ffb700 1 -- 172.21.15.106:0/1632314537 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594011d20 con 0x7f55a40d3610 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 -- 172.21.15.106:0/1632314537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40d3610 msgr2=0x7f55a40b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40d3610 0x7f55a40b5950 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5594009840 tx=0x7f5594009b50 comp rx=0 tx=0).stop 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 -- 172.21.15.106:0/1632314537 shutdown_connections 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40b5e90 0x7f55a40b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 --2- 172.21.15.106:0/1632314537 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40d3610 0x7f55a40b5950 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 -- 172.21.15.106:0/1632314537 >> 172.21.15.106:0/1632314537 conn(0x7f55a40d0950 msgr2=0x7f55a40d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:57.995 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 -- 172.21.15.106:0/1632314537 shutdown_connections 2023-11-24T06:14:57.996 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.990+0000 7f55a92ad700 1 -- 172.21.15.106:0/1632314537 wait complete. 2023-11-24T06:14:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.991+0000 7f55a92ad700 1 Processor -- start 2023-11-24T06:14:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.991+0000 7f55a92ad700 1 -- start start 2023-11-24T06:14:57.998 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40d3610 0x7f55a41f3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a415e480 0x7f55a40c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a41f4900 con 0x7f55a40b5e90 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4160b10 con 0x7f55a415e480 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a92ad700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4160df0 con 0x7f55a40d3610 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60346/0 (socket says 172.21.15.106:60346) 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 -- 172.21.15.106:0/2356795153 learned_addr learned my addr 172.21.15.106:0/2356795153 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a37fe700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a415e480 0x7f55a40c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:57.999 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 -- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40d3610 msgr2=0x7f55a41f3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40d3610 0x7f55a41f3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 -- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a415e480 msgr2=0x7f55a40c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a415e480 0x7f55a40c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 -- 172.21.15.106:0/2356795153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940094a0 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.992+0000 7f55a2ffd700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f558c0011e0 tx=0x7f558c00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.993+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c004c80 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.993+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f558c004e00 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.993+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558c007310 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.993+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a41610d0 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.993+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4160800 con 0x7f55a40b5e90 2023-11-24T06:14:58.000 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.994+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a4161310 con 0x7f55a40b5e90 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.994+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f558c007470 con 0x7f55a40b5e90 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.994+0000 7f559b7fe700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 0x7f558406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.995+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f558c089110 con 0x7f55a40b5e90 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.995+0000 7f55a27fc700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 0x7f558406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.995+0000 7f55a27fc700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 0x7f558406d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55940090b0 tx=0x7f5594010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.001 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:57.999+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f558c0544c0 con 0x7f55a40b5e90 2023-11-24T06:14:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.278+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f55a40751e0 con 0x7f55a40b5e90 2023-11-24T06:14:58.504 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.502+0000 7f559b7fe700 1 -- 172.21.15.106:0/2356795153 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v97) v1 ==== 167+0+0 (secure 0 0 0) 0x7f558c057ae0 con 0x7f55a40b5e90 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 msgr2=0x7f558406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 0x7f558406d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f55940090b0 tx=0x7f5594010000 comp rx=0 tx=0).stop 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 msgr2=0x7f55a41602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f558c0011e0 tx=0x7f558c00cae0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 shutdown_connections 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f558406aed0 0x7f558406d390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.507 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f55a415e480 0x7f55a40c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f55a40b5e90 0x7f55a41602c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 --2- 172.21.15.106:0/2356795153 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f55a40d3610 0x7f55a41f3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 >> 172.21.15.106:0/2356795153 conn(0x7f55a40d0950 msgr2=0x7f55a415d400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 shutdown_connections 2023-11-24T06:14:58.508 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.504+0000 7f55a92ad700 1 -- 172.21.15.106:0/2356795153 wait complete. 2023-11-24T06:14:58.520 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ERROR 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner: 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 8021, in test_volumes_module_finisher_thread 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T06:14:58.521 INFO:tasks.cephfs_test_runner: 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:Ran 1 test in 47.961s 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner: 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner: 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:====================================================================== 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:ERROR: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs/test_volumes.py", line 8021, in test_volumes_module_finisher_thread 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner: subvol1, subvol2, subvol3 = self._generate_random_subvolume_name(3) 2023-11-24T06:14:58.522 INFO:tasks.cephfs_test_runner:AttributeError: 'TestPerModuleFinsherThread' object has no attribute '_generate_random_subvolume_name' 2023-11-24T06:14:58.523 INFO:tasks.cephfs_test_runner: 2023-11-24T06:14:58.523 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T06:14:58.598 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8dd49751c9c047cda0097cd38b168586 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-11-24T06:14:58.600 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-11-24T06:14:58.612 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-11-24T06:14:58.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:14:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.804+0000 7f5e4c7f3700 1 Processor -- start 2023-11-24T06:14:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.804+0000 7f5e4c7f3700 1 -- start start 2023-11-24T06:14:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e4415e080 0x7f5e440b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f5e440af4d0 0x7f5e440afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e4406c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440af0b0 con 0x7f5e4415e080 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4406c9f0 con 0x7f5e440af4d0 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4c7f3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440b05a0 con 0x7f5e4406c000 2023-11-24T06:14:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e4415e080 0x7f5e440b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e4415e080 0x7f5e440b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60354/0 (socket says 172.21.15.106:60354) 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 -- 172.21.15.106:0/388405664 learned_addr learned my addr 172.21.15.106:0/388405664 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e49d8e700 1 --2- 172.21.15.106:0/388405664 >> v2:172.21.15.176:3300/0 conn(0x7f5e440af4d0 0x7f5e440afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4ad90700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e4406c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 -- 172.21.15.106:0/388405664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 msgr2=0x7f5e4406c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e4406c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 -- 172.21.15.106:0/388405664 >> v2:172.21.15.176:3300/0 conn(0x7f5e440af4d0 msgr2=0x7f5e440afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/388405664 >> v2:172.21.15.176:3300/0 conn(0x7f5e440af4d0 0x7f5e440afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4a58f700 1 -- 172.21.15.106:0/388405664 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440ae430 con 0x7f5e4415e080 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.805+0000 7f5e4ad90700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e4406c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e440b5050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406e4e0 tx=0x7f5e34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39204ae389a8ce28 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4958d700 1 -- 172.21.15.106:0/388405664 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400b870 con 0x7f5e4415e080 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4958d700 1 -- 172.21.15.106:0/388405664 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3400b9d0 con 0x7f5e4415e080 2023-11-24T06:14:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4958d700 1 -- 172.21.15.106:0/388405664 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400bd60 con 0x7f5e4415e080 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/388405664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 msgr2=0x7f5e440b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e440b5050 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406e4e0 tx=0x7f5e34009bd0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/388405664 shutdown_connections 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e4406c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/388405664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e440b5050 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/388405664 >> v2:172.21.15.176:3300/0 conn(0x7f5e440af4d0 0x7f5e440afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/388405664 >> 172.21.15.106:0/388405664 conn(0x7f5e44071b90 msgr2=0x7f5e44071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/388405664 shutdown_connections 2023-11-24T06:14:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.806+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/388405664 wait complete. 2023-11-24T06:14:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 Processor -- start 2023-11-24T06:14:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 -- start start 2023-11-24T06:14:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e44143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e440af4d0 0x7f5e441603d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415f430 con 0x7f5e4415e080 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415f710 con 0x7f5e440af4d0 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4c7f3700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415f9f0 con 0x7f5e4406c000 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4ad90700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4ad90700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60362/0 (socket says 172.21.15.106:60362) 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4ad90700 1 -- 172.21.15.106:0/667054187 learned_addr learned my addr 172.21.15.106:0/667054187 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:58.817 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e44143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.808+0000 7f5e49d8e700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e440af4d0 0x7f5e441603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 -- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 msgr2=0x7f5e44143f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e44143f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 -- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e440af4d0 msgr2=0x7f5e441603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e440af4d0 0x7f5e441603d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 -- 172.21.15.106:0/667054187 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009550 con 0x7f5e4415e080 2023-11-24T06:14:58.818 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4ad90700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00cef0 tx=0x7f5e3c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00ac80 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c00ade0 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e4415fcd0 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c015680 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.809+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e44144620 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.810+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e440753f0 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.810+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e3c00d430 con 0x7f5e4415e080 2023-11-24T06:14:58.819 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.811+0000 7f5e3affd700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 0x7f5e2806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.811+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5e3c0896a0 con 0x7f5e4415e080 2023-11-24T06:14:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.811+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 0x7f5e2806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.811+0000 7f5e4a58f700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 0x7f5e2806d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e34014040 tx=0x7f5e34008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:58.815+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e3c054ae0 con 0x7f5e4415e080 2023-11-24T06:14:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.005+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e44067f60 con 0x7f5e4415e080 2023-11-24T06:14:59.009 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.006+0000 7f5e3affd700 1 -- 172.21.15.106:0/667054187 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f5e3c058100 con 0x7f5e4415e080 2023-11-24T06:14:59.009 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:59.010 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":36,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:57.496847+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6835/2432507264":"2023-11-25T06:14:54.488554+0000","172.21.15.176:6833/2432507264":"2023-11-25T06:14:54.488554+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:14:59.011 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 msgr2=0x7f5e2806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 0x7f5e2806d390 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f5e34014040 tx=0x7f5e34008030 comp rx=0 tx=0).stop 2023-11-24T06:14:59.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 msgr2=0x7f5e44160910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c00cef0 tx=0x7f5e3c00cf20 comp rx=0 tx=0).stop 2023-11-24T06:14:59.012 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 shutdown_connections 2023-11-24T06:14:59.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f5e2806aed0 0x7f5e2806d390 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e4415e080 0x7f5e44160910 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f5e4406c000 0x7f5e44143f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.013 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 --2- 172.21.15.106:0/667054187 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f5e440af4d0 0x7f5e441603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 >> 172.21.15.106:0/667054187 conn(0x7f5e44071b90 msgr2=0x7f5e4415d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 shutdown_connections 2023-11-24T06:14:59.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.008+0000 7f5e4c7f3700 1 -- 172.21.15.106:0/667054187 wait complete. 2023-11-24T06:14:59.023 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-24T06:13:27.728296+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-24T06:14:59.024 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-24T06:14:59.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.144+0000 7fca382ba700 1 Processor -- start 2023-11-24T06:14:59.147 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.144+0000 7fca382ba700 1 -- start start 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca382ba700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 0x7fca3006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca382ba700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca300b4370 0x7fca3015b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca382ba700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca3006b530 con 0x7fca3015b370 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca382ba700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca300ae5e0 con 0x7fca300b4370 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca382ba700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca3015be30 con 0x7fca301587f0 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca36857700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca300b4370 0x7fca3015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.150 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca35855700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fca3015b370 0x7fca300b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40628/0 (socket says 172.21.15.106:40628) 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca36857700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca300b4370 0x7fca3015b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60370/0 (socket says 172.21.15.106:60370) 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.145+0000 7fca35855700 1 -- 172.21.15.106:0/2619607181 learned_addr learned my addr 172.21.15.106:0/2619607181 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36056700 1 --2- 172.21.15.106:0/2619607181 >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 0x7fca3006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36857700 1 -- 172.21.15.106:0/2619607181 >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 msgr2=0x7fca3006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36857700 1 --2- 172.21.15.106:0/2619607181 >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 0x7fca3006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36857700 1 -- 172.21.15.106:0/2619607181 >> v1:172.21.15.106:6789/0 conn(0x7fca3015b370 legacy=0x7fca300b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.151 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36857700 1 -- 172.21.15.106:0/2619607181 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3015c110 con 0x7fca300b4370 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36056700 1 --2- 172.21.15.106:0/2619607181 >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 0x7fca3006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca36857700 1 --2- 172.21.15.106:0/2619607181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca3015b800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bfa0 tx=0x7fca2800d330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb31b807ad8e6995 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca35054700 1 -- 172.21.15.106:0/2619607181 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca28010070 con 0x7fca300b4370 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca35054700 1 -- 172.21.15.106:0/2619607181 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2800b2e0 con 0x7fca300b4370 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca35054700 1 -- 172.21.15.106:0/2619607181 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca2800dcb0 con 0x7fca300b4370 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 -- 172.21.15.106:0/2619607181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 msgr2=0x7fca3015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 --2- 172.21.15.106:0/2619607181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca3015b800 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fca2800bfa0 tx=0x7fca2800d330 comp rx=0 tx=0).stop 2023-11-24T06:14:59.152 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 -- 172.21.15.106:0/2619607181 shutdown_connections 2023-11-24T06:14:59.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 --2- 172.21.15.106:0/2619607181 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca3015b800 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 --2- 172.21.15.106:0/2619607181 >> v2:172.21.15.176:3300/0 conn(0x7fca301587f0 0x7fca3006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.146+0000 7fca382ba700 1 -- 172.21.15.106:0/2619607181 >> 172.21.15.106:0/2619607181 conn(0x7fca300d0bf0 msgr2=0x7fca300d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.147+0000 7fca382ba700 1 -- 172.21.15.106:0/2619607181 shutdown_connections 2023-11-24T06:14:59.153 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.147+0000 7fca382ba700 1 -- 172.21.15.106:0/2619607181 wait complete. 2023-11-24T06:14:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 Processor -- start 2023-11-24T06:14:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 -- start start 2023-11-24T06:14:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.156 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca301587f0 0x7fca3015d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 0x7fca3009bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca30154170 con 0x7fca300b4370 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca30153320 con 0x7fca3015b370 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.148+0000 7fca382ba700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca30153530 con 0x7fca301587f0 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60372/0 (socket says 172.21.15.106:60372) 2023-11-24T06:14:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 -- 172.21.15.106:0/704693840 learned_addr learned my addr 172.21.15.106:0/704693840 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca35855700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca301587f0 0x7fca3015d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36857700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 0x7fca3009bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 -- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca301587f0 msgr2=0x7fca3015d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca301587f0 0x7fca3015d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 -- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 msgr2=0x7fca3009bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 0x7fca3009bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 -- 172.21.15.106:0/704693840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2800bc80 con 0x7fca300b4370 2023-11-24T06:14:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36857700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 0x7fca3009bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca36056700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c750 tx=0x7fca2000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011800 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca20011960 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca301537d0 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca20011cd0 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.149+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca30153d90 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.150+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca30061a10 con 0x7fca300b4370 2023-11-24T06:14:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.150+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fca20021350 con 0x7fca300b4370 2023-11-24T06:14:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.151+0000 7fca26ffd700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 0x7fca1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.151+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca20089220 con 0x7fca300b4370 2023-11-24T06:14:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.151+0000 7fca35855700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 0x7fca1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.151+0000 7fca35855700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 0x7fca1406d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca301fb410 tx=0x7fca2c009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.155+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fca200545d0 con 0x7fca300b4370 2023-11-24T06:14:59.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.343+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca30068fb0 con 0x7fca300b4370 2023-11-24T06:14:59.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.344+0000 7fca26ffd700 1 -- 172.21.15.106:0/704693840 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca20057bf0 con 0x7fca300b4370 2023-11-24T06:14:59.347 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 msgr2=0x7fca1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 0x7fca1406d390 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fca301fb410 tx=0x7fca2c009040 comp rx=0 tx=0).stop 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 msgr2=0x7fca300ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fca2000c750 tx=0x7fca2000cb10 comp rx=0 tx=0).stop 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 shutdown_connections 2023-11-24T06:14:59.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fca1406aed0 0x7fca1406d390 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fca3015b370 0x7fca3009bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca300b4370 0x7fca300ceb50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 --2- 172.21.15.106:0/704693840 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fca301587f0 0x7fca3015d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 >> 172.21.15.106:0/704693840 conn(0x7fca300d0bf0 msgr2=0x7fca300b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 shutdown_connections 2023-11-24T06:14:59.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.346+0000 7fca382ba700 1 -- 172.21.15.106:0/704693840 wait complete. 2023-11-24T06:14:59.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-11-24T06:14:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.482+0000 7fc507efd700 1 Processor -- start 2023-11-24T06:14:59.485 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.482+0000 7fc507efd700 1 -- start start 2023-11-24T06:14:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc507efd700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fc5000ce140 0x7fc50015f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc507efd700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5001414c0 con 0x7fc50015f630 2023-11-24T06:14:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc507efd700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5000ce9f0 con 0x7fc50015af10 2023-11-24T06:14:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc507efd700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50015c300 con 0x7fc5000ce140 2023-11-24T06:14:59.489 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc50649a700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc50015f630 0x7fc50006b640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40646/0 (socket says 172.21.15.106:40646) 2023-11-24T06:14:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc50649a700 1 -- 172.21.15.106:0/4184356986 learned_addr learned my addr 172.21.15.106:0/4184356986 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:14:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc505498700 1 --2- 172.21.15.106:0/4184356986 >> v2:172.21.15.176:3300/0 conn(0x7fc5000ce140 0x7fc50015f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310246846 0 0) 0x7fc5001414c0 con 0x7fc50015f630 2023-11-24T06:14:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.483+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4ec0035b0 con 0x7fc50015f630 2023-11-24T06:14:59.490 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701350253 0 0) 0x7fc4ec0035b0 con 0x7fc50015f630 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 >> v2:172.21.15.176:3300/0 conn(0x7fc5000ce140 msgr2=0x7fc50015f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 --2- 172.21.15.106:0/4184356986 >> v2:172.21.15.176:3300/0 conn(0x7fc5000ce140 0x7fc50015f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 >> v1:172.21.15.176:6789/0 conn(0x7fc50015af10 legacy=0x7fc50015e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5000cecd0 con 0x7fc50015f630 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fc4f80019f0 con 0x7fc50015f630 2023-11-24T06:14:59.491 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 >> v1:172.21.15.106:6789/0 conn(0x7fc50015f630 legacy=0x7fc50006b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc4ec003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ec004850 0x7fc4ec004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ec005210 0x7fc4ec00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50015c300 con 0x7fc4ec003a00 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec00c1b0 con 0x7fc4ec004850 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec00c370 con 0x7fc4ec005210 2023-11-24T06:14:59.492 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc4ec003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505498700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ec004850 0x7fc4ec004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc50649a700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ec005210 0x7fc4ec00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 -- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ec005210 msgr2=0x7fc4ec00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ec005210 0x7fc4ec00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 -- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ec004850 msgr2=0x7fc4ec004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ec004850 0x7fc4ec004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 -- 172.21.15.106:0/4184356986 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0035b0 con 0x7fc4ec003a00 2023-11-24T06:14:59.493 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc50649a700 1 -- 172.21.15.106:0/4184356986 reap_dead start 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc505c99700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc4ec003e20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00017c0 tx=0x7fc4ec005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f86d69d3cce1b06 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00052d0 con 0x7fc4ec003a00 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0005450 con 0x7fc4ec003a00 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.484+0000 7fc504c97700 1 -- 172.21.15.106:0/4184356986 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00038c0 con 0x7fc4ec003a00 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 -- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 msgr2=0x7fc4ec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc4ec003e20 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc4f00017c0 tx=0x7fc4ec005880 comp rx=0 tx=0).stop 2023-11-24T06:14:59.494 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 -- 172.21.15.106:0/4184356986 shutdown_connections 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 --2- 172.21.15.106:0/4184356986 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc4ec003e20 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 -- 172.21.15.106:0/4184356986 >> 172.21.15.106:0/4184356986 conn(0x7fc5000cd570 msgr2=0x7fc5000cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 -- 172.21.15.106:0/4184356986 shutdown_connections 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.485+0000 7fc507efd700 1 -- 172.21.15.106:0/4184356986 wait complete. 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.486+0000 7fc507efd700 1 Processor -- start 2023-11-24T06:14:59.495 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.486+0000 7fc507efd700 1 -- start start 2023-11-24T06:14:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc500143e10 0x7fc5000b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc500159390 0x7fc500159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.498 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500140b80 con 0x7fc4ec003a00 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc500141ca0 con 0x7fc500143e10 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc507efd700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5001405c0 con 0x7fc500159390 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60392/0 (socket says 172.21.15.106:60392) 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 -- 172.21.15.106:0/3308682959 learned_addr learned my addr 172.21.15.106:0/3308682959 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505498700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc500143e10 0x7fc5000b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc50649a700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc500159390 0x7fc500159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.499 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 -- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc500159390 msgr2=0x7fc500159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc500159390 0x7fc500159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 -- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc500143e10 msgr2=0x7fc5000b13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc500143e10 0x7fc5000b13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.487+0000 7fc505c99700 1 -- 172.21.15.106:0/3308682959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5001408a0 con 0x7fc4ec003a00 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc505c99700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c180 tx=0x7fc4f0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.500 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f0001290 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f0007040 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc500141930 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f00073f0 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.488+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc500144290 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.489+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc500141f80 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.489+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4f0007550 con 0x7fc4ec003a00 2023-11-24T06:14:59.501 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.489+0000 7fc4f67fc700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 0x7fc4e406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:14:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.489+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4f0089d10 con 0x7fc4ec003a00 2023-11-24T06:14:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.490+0000 7fc505498700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 0x7fc4e406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:14:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.490+0000 7fc505498700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 0x7fc4e406d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc50015e300 tx=0x7fc4fc008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:14:59.502 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.494+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4f0055270 con 0x7fc4ec003a00 2023-11-24T06:14:59.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.744+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fc500067f60 con 0x7fc4ec003a00 2023-11-24T06:14:59.752 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.749+0000 7fc4f67fc700 1 -- 172.21.15.106:0/3308682959 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v5) v1 ==== 81+0+466147 (secure 0 0 0) 0x7fc4f002b090 con 0x7fc4ec003a00 2023-11-24T06:14:59.757 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 5, 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout: "active_gid": 4110, 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout: "active_name": "y", 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout: "active_addrs": { 2023-11-24T06:14:59.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6832", 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 822714821 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2023-11-24T06:14:59.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6833", 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 822714821 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: "active_addr": "172.21.15.106:6833/822714821", 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: "active_change": "2023-11-24T06:13:21.678923+0000", 2023-11-24T06:14:59.760 INFO:teuthology.orchestra.run.smithi106.stdout: "active_mgr_features": 4540138322906710015, 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "available": true, 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "standbys": [ 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "gid": 4103, 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "x", 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr_features": 4540138322906710015, 2023-11-24T06:14:59.761 INFO:teuthology.orchestra.run.smithi106.stdout: "available_modules": [ 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "alerts", 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:14:59.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.763 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:14:59.764 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.765 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.766 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.767 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.768 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.769 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.770 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.771 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.772 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.773 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_destination": { 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_destination", 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.774 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Email address to send alerts to", 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_from_name": { 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_from_name", 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "Ceph", 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.776 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Email From: name", 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.777 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_host": { 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_host", 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.778 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP server", 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_password": { 2023-11-24T06:14:59.779 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_password", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.780 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Password to authenticate with", 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_port": { 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_port", 2023-11-24T06:14:59.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "465", 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.782 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP port", 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_sender": { 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_sender", 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.783 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP envelope sender", 2023-11-24T06:14:59.784 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_ssl": { 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_ssl", 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.785 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T06:14:59.786 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_user": { 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_user", 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.787 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "User to authenticate as", 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.788 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "balancer", 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:14:59.789 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "active": { 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "active", 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.790 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "begin_time": { 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "begin_time", 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0000", 2023-11-24T06:14:59.792 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.793 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.793 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.793 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "begin_weekday": { 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "begin_weekday", 2023-11-24T06:14:59.794 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "6", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T06:14:59.795 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_max_iterations": { 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_max_iterations", 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:14:59.796 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "25", 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "250", 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T06:14:59.797 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_metrics": { 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_metrics", 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.798 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T06:14:59.799 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_step": { 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_step", 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.800 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0.5", 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0.001", 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "0.999", 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "aggressiveness of optimization", 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "end_time": { 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "end_time", 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "2359", 2023-11-24T06:14:59.802 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "end_weekday": { 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "end_weekday", 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0", 2023-11-24T06:14:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "6", 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:14:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:14:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:14:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "min_score": { 2023-11-24T06:14:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "min_score", 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "mode": { 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mode", 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "upmap", 2023-11-24T06:14:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "crush-compat", 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "none", 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap" 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Balancer mode", 2023-11-24T06:14:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_ids": { 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pool_ids", 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T06:14:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:14:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.824 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap_max_deviation": { 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "upmap_max_deviation", 2023-11-24T06:14:59.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.826 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap_max_optimizations": { 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "upmap_max_optimizations", 2023-11-24T06:14:59.827 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T06:14:59.828 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephadm", 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_down_multiplier": { 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_down_multiplier", 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.830 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3.0", 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.831 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_refresh_rate": { 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_refresh_rate", 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.832 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "20", 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.833 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_starting_port": { 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_starting_port", 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.834 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "4721", 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.835 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_ptrace": { 2023-11-24T06:14:59.836 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_ptrace", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.837 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.838 INFO:teuthology.orchestra.run.smithi106.stdout: "autotune_interval": { 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "autotune_interval", 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.839 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.840 INFO:teuthology.orchestra.run.smithi106.stdout: "autotune_memory_target_ratio": { 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0.7", 2023-11-24T06:14:59.841 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm_log_destination": { 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephadm_log_destination", 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.843 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "file", 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "file,syslog", 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "syslog" 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T06:14:59.844 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "cgroups_split": { 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cgroups_split", 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.845 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.846 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "config_checks_enabled": { 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "config_checks_enabled", 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.847 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "config_dashboard": { 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "config_dashboard", 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.849 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.850 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_alertmanager": { 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_alertmanager", 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T06:14:59.852 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_base": { 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_base", 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.854 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Container image name, without the tag", 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_elasticsearch": { 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_elasticsearch", 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T06:14:59.856 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "elasticsearch container image", 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.857 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_grafana": { 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_grafana", 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.858 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.859 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_haproxy": { 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_haproxy", 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T06:14:59.860 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "HAproxy container image", 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.861 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_agent": { 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_agent", 2023-11-24T06:14:59.862 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.863 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger agent container image", 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.864 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_collector": { 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_collector", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.865 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger collector container image", 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_query": { 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_query", 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.867 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger query container image", 2023-11-24T06:14:59.868 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_keepalived": { 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_keepalived", 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.869 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.870 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Keepalived container image", 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_loki": { 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_loki", 2023-11-24T06:14:59.871 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.872 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Loki container image", 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_node_exporter": { 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_node_exporter", 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.873 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:14:59.874 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_nvmeof": { 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_nvmeof", 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.875 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.876 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Nvme-of container image", 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_prometheus": { 2023-11-24T06:14:59.877 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_prometheus", 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.878 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_promtail": { 2023-11-24T06:14:59.879 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_promtail", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.880 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Promtail container image", 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_snmp_gateway": { 2023-11-24T06:14:59.881 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_snmp_gateway", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.882 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SNMP Gateway container image", 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "container_init": { 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_init", 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.883 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T06:14:59.884 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "daemon_cache_timeout": { 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "daemon_cache_timeout", 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.885 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.886 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "default_cephadm_command_timeout": { 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.887 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "900", 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "default_registry": { 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "default_registry", 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io", 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.889 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.890 INFO:teuthology.orchestra.run.smithi106.stdout: "device_cache_timeout": { 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_cache_timeout", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1800", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.891 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache device inventory", 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "device_enhanced_scan": { 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_enhanced_scan", 2023-11-24T06:14:59.892 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.893 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "facts_cache_timeout": { 2023-11-24T06:14:59.894 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "facts_cache_timeout", 2023-11-24T06:14:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache host facts data", 2023-11-24T06:14:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "host_check_interval": { 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "host_check_interval", 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to perform a host check", 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "inventory_list_all": { 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "inventory_list_all", 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "log_refresh_metadata": { 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_refresh_metadata", 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T06:14:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:14:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.912 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.913 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "*", 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.917 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "max_count_per_host": { 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_count_per_host", 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:14:59.918 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "max number of daemons per service per host", 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "max_osd_draining_count": { 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_osd_draining_count", 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.920 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "migration_current": { 2023-11-24T06:14:59.921 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "migration_current", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.922 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "internal - do not modify", 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "mode": { 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mode", 2023-11-24T06:14:59.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "root", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm-package", 2023-11-24T06:14:59.924 INFO:teuthology.orchestra.run.smithi106.stdout: "root" 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.925 INFO:teuthology.orchestra.run.smithi106.stdout: "prometheus_alerts_path": { 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prometheus_alerts_path", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.926 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_insecure": { 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_insecure", 2023-11-24T06:14:59.927 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.928 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_password": { 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_password", 2023-11-24T06:14:59.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T06:14:59.930 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_url": { 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_url", 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.931 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T06:14:59.932 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_username": { 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_username", 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.933 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.934 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: "secure_monitoring_stack": { 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "secure_monitoring_stack", 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.935 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.936 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "service_discovery_port": { 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "service_discovery_port", 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.937 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8765", 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "cephadm service discovery port", 2023-11-24T06:14:59.938 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "ssh_config_file": { 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssh_config_file", 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.939 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.940 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "use_agent": { 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "use_agent", 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.941 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.942 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "use_repo_digest": { 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "use_repo_digest", 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.943 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.944 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_failed_host_check": { 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_failed_host_check", 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.945 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.946 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_stray_daemons": { 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_stray_daemons", 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.947 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.948 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_stray_hosts": { 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_stray_hosts", 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.949 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crash", 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:14:59.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.952 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.953 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.954 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.955 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:14:59.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:14:59.957 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.958 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.959 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.960 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "retain_interval": { 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "retain_interval", 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.961 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "31536000", 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T06:14:59.962 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_recent_interval": { 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_recent_interval", 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:14:59.963 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1209600", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.964 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "dashboard", 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:14:59.965 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.966 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.967 INFO:teuthology.orchestra.run.smithi106.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "AUDIT_API_ENABLED": { 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T06:14:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T06:14:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T06:14:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T06:14:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T06:14:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T06:14:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:14:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T06:14:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_URL": { 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_URL", 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.995 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.996 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.997 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:14:59.998 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:14:59.999 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.000 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.001 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.002 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.003 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.004 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.005 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.006 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.008 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.010 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T06:15:00.011 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.012 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.013 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.014 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.017 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T06:15:00.017 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T06:15:00.017 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.017 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.018 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.018 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.018 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.018 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.018 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T06:15:00.019 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.020 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T06:15:00.021 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.022 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T06:15:00.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.024 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.025 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.027 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T06:15:00.028 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.029 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.030 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.031 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.032 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "45", 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.034 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.035 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.036 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T06:15:00.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.038 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.039 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.040 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.041 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.043 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.045 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.046 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.047 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.048 INFO:teuthology.orchestra.run.smithi106.stdout: "cross_origin_url": { 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cross_origin_url", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.049 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "crt_file": { 2023-11-24T06:15:00.050 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crt_file", 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.051 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.052 INFO:teuthology.orchestra.run.smithi106.stdout: "debug": { 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "debug", 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.053 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable/disable debug options", 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.054 INFO:teuthology.orchestra.run.smithi106.stdout: "jwt_token_ttl": { 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "jwt_token_ttl", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "28800", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.055 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "key_file": { 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "key_file", 2023-11-24T06:15:00.056 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.057 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.058 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.059 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.060 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.061 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.062 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.063 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.064 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.065 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.066 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.067 INFO:teuthology.orchestra.run.smithi106.stdout: "motd": { 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "motd", 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.068 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "The message of the day", 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "redirect_resolve_ip_addr": { 2023-11-24T06:15:00.069 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.070 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:00.071 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "::", 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.072 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.073 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8080", 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.074 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl": { 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl", 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.075 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.076 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl_server_port": { 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl_server_port", 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8443", 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.078 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_behaviour": { 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_behaviour", 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "redirect", 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "redirect" 2023-11-24T06:15:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_error_status_code": { 2023-11-24T06:15:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_error_status_code", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "500", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "400", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "599", 2023-11-24T06:15:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "url_prefix": { 2023-11-24T06:15:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "url_prefix", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "devicehealth", 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "enable_monitoring": { 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enable_monitoring", 2023-11-24T06:15:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "monitor device health metrics", 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "mark_out_threshold": { 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mark_out_threshold", 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "2419200", 2023-11-24T06:15:00.098 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.099 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": { 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pool_name", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "device_health_metrics", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.100 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "retention_period": { 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "retention_period", 2023-11-24T06:15:00.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15552000", 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.102 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long to retain device health metrics", 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "scrape_frequency": { 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "scrape_frequency", 2023-11-24T06:15:00.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "86400", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T06:15:00.104 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "self_heal": { 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "self_heal", 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.105 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T06:15:00.106 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.107 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.108 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_threshold": { 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_threshold", 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.109 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "7257600", 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.110 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "diskprediction_local", 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.111 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.112 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.113 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.115 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.116 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.117 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.118 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.119 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.120 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "predict_interval": { 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "predict_interval", 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.121 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "86400", 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.122 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "predictor_model": { 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "predictor_model", 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.123 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "prophetstor", 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.124 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.125 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.126 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "influx", 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": false, 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "influxdb python module not found", 2023-11-24T06:15:00.127 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "batch_size": { 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "batch_size", 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.128 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5000", 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "database": { 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "database", 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "ceph", 2023-11-24T06:15:00.130 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": { 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "hostname", 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.132 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB server hostname", 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.133 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "30", 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "5", 2023-11-24T06:15:00.134 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.135 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.136 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.137 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.138 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.139 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.141 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.142 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.143 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.144 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "password": { 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "password", 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.145 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "password of InfluxDB server user", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.146 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "port": { 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "port", 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.147 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8086", 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB server port", 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl": { 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl", 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "false", 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "threads": { 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "threads", 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "32", 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "username": { 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "username", 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "username of InfluxDB server user", 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "verify_ssl": { 2023-11-24T06:15:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "verify_ssl", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "true", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "insights", 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "iostat", 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.168 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.169 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.170 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.171 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.172 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.173 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.174 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.175 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "localpool", 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "failure_domain": { 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "failure_domain", 2023-11-24T06:15:00.177 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "host", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "failure domain for any created local pool", 2023-11-24T06:15:00.178 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.179 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.180 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.181 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.182 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.183 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.184 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.185 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.186 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.187 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.188 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": { 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "min_size", 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.189 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default min_size for any created local pool", 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.190 INFO:teuthology.orchestra.run.smithi106.stdout: "num_rep": { 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "num_rep", 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3", 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.191 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default replica count for any created local pool", 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.192 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": { 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pg_num", 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "128", 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.193 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "prefix": { 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prefix", 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.195 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "name prefix for any created local pool", 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.196 INFO:teuthology.orchestra.run.smithi106.stdout: "subtree": { 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "subtree", 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "rack", 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.197 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mds_autoscaler", 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.199 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.200 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.201 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.202 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.203 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.204 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.205 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.206 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.207 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.208 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mirroring", 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.211 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.212 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.213 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.214 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.215 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.216 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.217 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.218 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.219 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "nfs", 2023-11-24T06:15:00.220 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.221 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.222 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.223 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.224 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.226 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.227 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.229 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "orchestrator", 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "fail_fs": { 2023-11-24T06:15:00.231 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "fail_fs", 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.232 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.233 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator": { 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "orchestrator", 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm", 2023-11-24T06:15:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "rook", 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "test_orchestrator" 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Orchestrator backend", 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "osd_perf_query", 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.252 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.253 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.255 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "osd_support", 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.257 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.258 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.259 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.260 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.261 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.262 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.263 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.264 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.265 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.266 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pg_autoscaler", 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.267 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.268 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.269 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.271 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.272 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.273 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.274 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.276 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.278 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "threshold": { 2023-11-24T06:15:00.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "threshold", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3.0", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1.0", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.280 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "scaling threshold", 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "progress", 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_pg_recovery_event": { 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_pg_recovery_event", 2023-11-24T06:15:00.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T06:15:00.283 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "enabled": { 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enabled", 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.284 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.285 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.286 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.287 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.288 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.289 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.290 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.291 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.292 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.293 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.294 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.295 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "max_completed_events": { 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_completed_events", 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.296 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "50", 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "number of past completed events to remember", 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.297 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.298 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long the module is going to sleep", 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.299 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prometheus", 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.300 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "cache": { 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cache", 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.301 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "exclude_perf_counters": { 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "exclude_perf_counters", 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.303 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.305 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.306 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.308 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.309 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.310 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.311 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.312 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.313 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_stats_pools": { 2023-11-24T06:15:00.314 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_stats_pools", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.315 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T06:15:00.316 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "300", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.317 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "scrape_interval": { 2023-11-24T06:15:00.318 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "scrape_interval", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15.0", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.319 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:00.320 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "::", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.321 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:00.322 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "9283", 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "stale_cache_strategy": { 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "stale_cache_strategy", 2023-11-24T06:15:00.324 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "log", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.325 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_behaviour": { 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_behaviour", 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.326 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.327 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "default", 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "default", 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "error" 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.328 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_error_status_code": { 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_error_status_code", 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.329 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "500", 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "400", 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "599", 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.330 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_support", 2023-11-24T06:15:00.331 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.332 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.333 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.335 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.336 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.337 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.338 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.340 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "max_concurrent_snap_create": { 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_concurrent_snap_create", 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.341 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.342 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "mirror_snapshot_schedule": { 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.343 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.344 INFO:teuthology.orchestra.run.smithi106.stdout: "trash_purge_schedule": { 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "trash_purge_schedule", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.345 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.346 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.346 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.346 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.346 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.346 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "restful", 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.347 INFO:teuthology.orchestra.run.smithi106.stdout: "enable_auth": { 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enable_auth", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.348 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "key_file": { 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "key_file", 2023-11-24T06:15:00.349 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.350 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.351 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.352 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.354 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.355 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.356 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.357 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.358 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.359 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.360 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.362 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.363 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rgw", 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.364 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.365 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.366 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.367 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.368 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.369 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.370 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.372 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rook", 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "drive_group_interval": { 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "drive_group_interval", 2023-11-24T06:15:00.374 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "300.0", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-11-24T06:15:00.375 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.376 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.377 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.378 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.379 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.380 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.381 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.382 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.383 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.384 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "storage_class": { 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "storage_class", 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.385 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "local", 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "selftest", 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.387 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.388 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.389 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.391 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.392 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.393 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.395 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.396 INFO:teuthology.orchestra.run.smithi106.stdout: "roption1": { 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "roption1", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.397 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "roption2": { 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "roption2", 2023-11-24T06:15:00.398 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "xyz", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.399 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption1": { 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption1", 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.400 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.401 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption2": { 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption2", 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.402 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption3": { 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption3", 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.404 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption4": { 2023-11-24T06:15:00.405 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption4", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.406 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption5": { 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption5", 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.407 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.408 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption6": { 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption6", 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.409 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.410 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption7": { 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption7", 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.411 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "42", 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.412 INFO:teuthology.orchestra.run.smithi106.stdout: "testkey": { 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testkey", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.413 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "testlkey": { 2023-11-24T06:15:00.414 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testlkey", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.415 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "testnewline": { 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testnewline", 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.416 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.417 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "snap_schedule", 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.418 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_m_granularity": { 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_m_granularity", 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.419 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.420 INFO:teuthology.orchestra.run.smithi106.stdout: "dump_on_update": { 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "dump_on_update", 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.421 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.422 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.422 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "dump database to debug log on update", 2023-11-24T06:15:00.422 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.422 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.425 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.426 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.427 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.428 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.430 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.431 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.433 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.434 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "stats", 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.435 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.436 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.438 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.439 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.440 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.441 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.443 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "status", 2023-11-24T06:15:00.444 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.445 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.446 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.447 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.448 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.449 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.450 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.451 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.452 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.453 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "telegraf", 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.454 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "address": { 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "address", 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T06:15:00.455 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.456 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.457 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.458 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.459 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.460 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.461 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.463 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.464 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.465 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.466 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "telemetry", 2023-11-24T06:15:00.467 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_basic": { 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_basic", 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.468 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_crash": { 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_crash", 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.470 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_device": { 2023-11-24T06:15:00.471 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_device", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.472 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_ident": { 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_ident", 2023-11-24T06:15:00.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T06:15:00.474 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_perf": { 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_perf", 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.475 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.476 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "contact": { 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "contact", 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.477 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.478 INFO:teuthology.orchestra.run.smithi106.stdout: "description": { 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "description", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.479 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "device_url": { 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_url", 2023-11-24T06:15:00.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.481 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "enabled": { 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enabled", 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.482 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.483 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "24", 2023-11-24T06:15:00.484 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "8", 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.485 INFO:teuthology.orchestra.run.smithi106.stdout: "last_opt_revision": { 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "last_opt_revision", 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1", 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.486 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "leaderboard": { 2023-11-24T06:15:00.487 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "leaderboard", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.488 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "leaderboard_description": { 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "leaderboard_description", 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.489 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.490 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.491 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.492 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.493 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.494 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.496 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.497 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.498 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.499 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "organization": { 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "organization", 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.500 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.501 INFO:teuthology.orchestra.run.smithi106.stdout: "proxy": { 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "proxy", 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.502 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "url": { 2023-11-24T06:15:00.503 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "url", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.504 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.505 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "test_orchestrator", 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.506 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.507 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.509 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.510 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.511 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.512 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.513 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.514 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "volumes", 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.515 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.516 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.517 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.518 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.519 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.520 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.521 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.522 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.523 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.524 INFO:teuthology.orchestra.run.smithi106.stdout: "max_concurrent_clones": { 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_concurrent_clones", 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "4", 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.525 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "periodic_async_work": { 2023-11-24T06:15:00.526 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "periodic_async_work", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.527 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Periodically check for async work", 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "snapshot_clone_delay": { 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "snapshot_clone_delay", 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.528 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.529 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix", 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.530 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "discovery_interval": { 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "discovery_interval", 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "100", 2023-11-24T06:15:00.531 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.532 INFO:teuthology.orchestra.run.smithi106.stdout: "identifier": { 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "identifier", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.533 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.534 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.535 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.536 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.537 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.539 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.540 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.541 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.542 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.543 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.544 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_host": { 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_host", 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.545 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.546 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_port": { 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_port", 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10051", 2023-11-24T06:15:00.547 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.548 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_sender": { 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_sender", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.549 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: "modules": [ 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: "iostat", 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: "nfs", 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: "restful" 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.551 INFO:teuthology.orchestra.run.smithi106.stdout: "available_modules": [ 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "alerts", 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.552 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How frequently to reexamine health status", 2023-11-24T06:15:00.553 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.554 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.555 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.556 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.557 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.558 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.559 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.560 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.561 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.562 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_destination": { 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_destination", 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.563 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Email address to send alerts to", 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_from_name": { 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_from_name", 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "Ceph", 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.565 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Email From: name", 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_host": { 2023-11-24T06:15:00.566 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_host", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.567 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP server", 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_password": { 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_password", 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.568 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Password to authenticate with", 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.569 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_port": { 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_port", 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "465", 2023-11-24T06:15:00.570 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP port", 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.571 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_sender": { 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_sender", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.572 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SMTP envelope sender", 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_ssl": { 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_ssl", 2023-11-24T06:15:00.573 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use SSL to connect to SMTP server", 2023-11-24T06:15:00.574 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "smtp_user": { 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "smtp_user", 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.575 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "User to authenticate as", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.576 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "balancer", 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.577 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "active": { 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "active", 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.578 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "automatically balance PGs across cluster", 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.579 INFO:teuthology.orchestra.run.smithi106.stdout: "begin_time": { 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "begin_time", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0000", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.580 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "beginning time of day to automatically balance", 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "begin_weekday": { 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "begin_weekday", 2023-11-24T06:15:00.581 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "6", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-11-24T06:15:00.582 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_max_iterations": { 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_max_iterations", 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.583 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "25", 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "250", 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.584 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_metrics": { 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_metrics", 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.585 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "pgs,objects,bytes", 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_compat_step": { 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crush_compat_step", 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0.5", 2023-11-24T06:15:00.587 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0.001", 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "0.999", 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "aggressiveness of optimization", 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.588 INFO:teuthology.orchestra.run.smithi106.stdout: "end_time": { 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "end_time", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "2359", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.589 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "ending time of day to automatically balance", 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "end_weekday": { 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "end_weekday", 2023-11-24T06:15:00.590 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "0", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "6", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-11-24T06:15:00.591 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.592 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.593 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.595 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.596 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.597 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.598 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.599 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.600 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "min_score": { 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "min_score", 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.601 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "mode": { 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mode", 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "upmap", 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.603 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "crush-compat", 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "none", 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap" 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Balancer mode", 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.604 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_ids": { 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pool_ids", 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.605 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.606 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:00.607 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.608 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap_max_deviation": { 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "upmap_max_deviation", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.609 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "deviation below which no optimization is attempted", 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "upmap_max_optimizations": { 2023-11-24T06:15:00.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "upmap_max_optimizations", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.611 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.612 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephadm", 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_down_multiplier": { 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_down_multiplier", 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.613 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3.0", 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.614 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_refresh_rate": { 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_refresh_rate", 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.615 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "20", 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "agent_starting_port": { 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "agent_starting_port", 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "4721", 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.617 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.618 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_ptrace": { 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_ptrace", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.619 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "autotune_interval": { 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "autotune_interval", 2023-11-24T06:15:00.620 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to autotune daemon memory", 2023-11-24T06:15:00.621 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "autotune_memory_target_ratio": { 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "autotune_memory_target_ratio", 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:00.622 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0.7", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.623 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm_log_destination": { 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cephadm_log_destination", 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.624 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "file", 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "file,syslog", 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "syslog" 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.625 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Destination for cephadm command's persistent logging", 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "cgroups_split": { 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cgroups_split", 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.626 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.627 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "config_checks_enabled": { 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "config_checks_enabled", 2023-11-24T06:15:00.629 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.630 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "config_dashboard": { 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "config_dashboard", 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.631 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.632 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_alertmanager": { 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_alertmanager", 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.633 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.634 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_base": { 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_base", 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/ceph", 2023-11-24T06:15:00.635 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Container image name, without the tag", 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.636 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_elasticsearch": { 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_elasticsearch", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.637 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "elasticsearch container image", 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_grafana": { 2023-11-24T06:15:00.638 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_grafana", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.639 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_haproxy": { 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_haproxy", 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.640 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "HAproxy container image", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.641 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_agent": { 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_agent", 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.642 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger agent container image", 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_collector": { 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_collector", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.644 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger collector container image", 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_jaeger_query": { 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_jaeger_query", 2023-11-24T06:15:00.645 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.646 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Jaeger query container image", 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_keepalived": { 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_keepalived", 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.647 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Keepalived container image", 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.648 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_loki": { 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_loki", 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-11-24T06:15:00.649 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Loki container image", 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.650 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_node_exporter": { 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_node_exporter", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.651 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_nvmeof": { 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_nvmeof", 2023-11-24T06:15:00.652 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/ceph/nvmeof:latest", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Nvme-of container image", 2023-11-24T06:15:00.653 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_prometheus": { 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_prometheus", 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.654 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Prometheus container image", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.655 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_promtail": { 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_promtail", 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.656 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Promtail container image", 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "container_image_snmp_gateway": { 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_image_snmp_gateway", 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.658 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "SNMP Gateway container image", 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "container_init": { 2023-11-24T06:15:00.659 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "container_init", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Run podman/docker with `--init`", 2023-11-24T06:15:00.660 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "daemon_cache_timeout": { 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "daemon_cache_timeout", 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.661 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.662 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "default_cephadm_command_timeout": { 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "default_cephadm_command_timeout", 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "900", 2023-11-24T06:15:00.663 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.664 INFO:teuthology.orchestra.run.smithi106.stdout: "default_registry": { 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "default_registry", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "docker.io", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.665 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "device_cache_timeout": { 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_cache_timeout", 2023-11-24T06:15:00.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1800", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache device inventory", 2023-11-24T06:15:00.667 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "device_enhanced_scan": { 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_enhanced_scan", 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.668 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use libstoragemgmt during device scans", 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.669 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "facts_cache_timeout": { 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "facts_cache_timeout", 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:00.670 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "seconds to cache host facts data", 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.671 INFO:teuthology.orchestra.run.smithi106.stdout: "host_check_interval": { 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "host_check_interval", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.672 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to perform a host check", 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "inventory_list_all": { 2023-11-24T06:15:00.673 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "inventory_list_all", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.674 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.675 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.676 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.677 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "log_refresh_metadata": { 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_refresh_metadata", 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.678 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.680 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.681 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.682 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.683 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.684 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.685 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "manage_etc_ceph_ceph_conf": { 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.686 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.687 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "*", 2023-11-24T06:15:00.688 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.689 INFO:teuthology.orchestra.run.smithi106.stdout: "max_count_per_host": { 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_count_per_host", 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.690 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "max number of daemons per service per host", 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "max_osd_draining_count": { 2023-11-24T06:15:00.691 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_osd_draining_count", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.692 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "migration_current": { 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "migration_current", 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.693 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "internal - do not modify", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.694 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "mode": { 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mode", 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.695 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "root", 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm-package", 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "root" 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "mode for remote execution of cephadm", 2023-11-24T06:15:00.696 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "prometheus_alerts_path": { 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prometheus_alerts_path", 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.697 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.698 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_insecure": { 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_insecure", 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.699 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_password": { 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_password", 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_url": { 2023-11-24T06:15:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_url", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "registry_username": { 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "registry_username", 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "secure_monitoring_stack": { 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "secure_monitoring_stack", 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "service_discovery_port": { 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "service_discovery_port", 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.708 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8765", 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "cephadm service discovery port", 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "ssh_config_file": { 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssh_config_file", 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.710 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "use_agent": { 2023-11-24T06:15:00.711 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "use_agent", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.712 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "use_repo_digest": { 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "use_repo_digest", 2023-11-24T06:15:00.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-11-24T06:15:00.714 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_failed_host_check": { 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_failed_host_check", 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.715 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if the host check fails", 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.716 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_stray_daemons": { 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_stray_daemons", 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.717 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_on_stray_hosts": { 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_on_stray_hosts", 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.719 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crash", 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.721 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.722 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.723 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.724 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.725 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.726 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.727 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.728 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.729 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "retain_interval": { 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "retain_interval", 2023-11-24T06:15:00.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "31536000", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long to retain crashes before pruning them", 2023-11-24T06:15:00.731 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_recent_interval": { 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_recent_interval", 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.732 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1209600", 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "time interval in which to warn about recent crashes", 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.733 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "dashboard", 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.734 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.735 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.736 INFO:teuthology.orchestra.run.smithi106.stdout: "ALERTMANAGER_API_HOST": { 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ALERTMANAGER_API_HOST", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.737 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-11-24T06:15:00.738 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.739 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "AUDIT_API_ENABLED": { 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "AUDIT_API_ENABLED", 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.740 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.741 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.742 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "ENABLE_BROWSABLE_API": { 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ENABLE_BROWSABLE_API", 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.744 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-11-24T06:15:00.745 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.746 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.747 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.748 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.749 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.751 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_NFS": { 2023-11-24T06:15:00.752 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.753 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_RBD": { 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-11-24T06:15:00.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.755 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "FEATURE_TOGGLE_RGW": { 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.756 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.757 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.758 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_PASSWORD": { 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_PASSWORD", 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.760 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-11-24T06:15:00.761 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.762 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_URL": { 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_URL", 2023-11-24T06:15:00.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.764 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_API_USERNAME": { 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_API_USERNAME", 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.765 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.766 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.767 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.768 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.769 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.770 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.771 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.772 INFO:teuthology.orchestra.run.smithi106.stdout: "ISSUE_TRACKER_API_KEY": { 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.773 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "PROMETHEUS_API_HOST": { 2023-11-24T06:15:00.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PROMETHEUS_API_HOST", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.775 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.776 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.777 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.778 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.779 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.780 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.782 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.783 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.784 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-11-24T06:15:00.785 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.786 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-11-24T06:15:00.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.788 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.789 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.790 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_ENABLED": { 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_ENABLED", 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.791 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.792 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.793 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.794 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.795 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8", 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.797 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "REST_REQUESTS_TIMEOUT": { 2023-11-24T06:15:00.798 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "45", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.799 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_ACCESS_KEY": { 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_ACCESS_KEY", 2023-11-24T06:15:00.800 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.801 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "admin", 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_SECRET_KEY": { 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_SECRET_KEY", 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "RGW_API_SSL_VERIFY": { 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "RGW_API_SSL_VERIFY", 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "UNSAFE_TLS_v1_2": { 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "UNSAFE_TLS_v1_2", 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "cross_origin_url": { 2023-11-24T06:15:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cross_origin_url", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "crt_file": { 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "crt_file", 2023-11-24T06:15:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "debug": { 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "debug", 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Enable/disable debug options", 2023-11-24T06:15:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "jwt_token_ttl": { 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "jwt_token_ttl", 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "28800", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "key_file": { 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "key_file", 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.827 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.828 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.830 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.831 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "motd": { 2023-11-24T06:15:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "motd", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "The message of the day", 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "redirect_resolve_ip_addr": { 2023-11-24T06:15:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "redirect_resolve_ip_addr", 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "::", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8080", 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl": { 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl", 2023-11-24T06:15:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl_server_port": { 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl_server_port", 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8443", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_behaviour": { 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_behaviour", 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "redirect", 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "redirect" 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_error_status_code": { 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_error_status_code", 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "500", 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "400", 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "599", 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "url_prefix": { 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "url_prefix", 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "devicehealth", 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "enable_monitoring": { 2023-11-24T06:15:00.853 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enable_monitoring", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.854 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "monitor device health metrics", 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.855 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.856 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.857 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.858 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.859 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.860 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.861 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.863 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "mark_out_threshold": { 2023-11-24T06:15:00.864 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mark_out_threshold", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "2419200", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.865 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "pool_name": { 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pool_name", 2023-11-24T06:15:00.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "device_health_metrics", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "name of pool in which to store device health metrics", 2023-11-24T06:15:00.867 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "retention_period": { 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "retention_period", 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.868 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15552000", 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long to retain device health metrics", 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.869 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "scrape_frequency": { 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "scrape_frequency", 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "86400", 2023-11-24T06:15:00.870 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to scrape device health metrics", 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "self_heal": { 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "self_heal", 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.872 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.873 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.874 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how frequently to wake up and check device health", 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "warn_threshold": { 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "warn_threshold", 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.875 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "7257600", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.876 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "diskprediction_local", 2023-11-24T06:15:00.877 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.878 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.879 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.880 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.881 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.883 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.884 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.885 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.886 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "predict_interval": { 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "predict_interval", 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "86400", 2023-11-24T06:15:00.887 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.888 INFO:teuthology.orchestra.run.smithi106.stdout: "predictor_model": { 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "predictor_model", 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "prophetstor", 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.889 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:00.890 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "600", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.891 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.892 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "influx", 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": false, 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "influxdb python module not found", 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "batch_size": { 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "batch_size", 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.893 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5000", 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.894 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "database": { 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "database", 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "ceph", 2023-11-24T06:15:00.895 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": { 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "hostname", 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.897 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB server hostname", 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.898 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "30", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "5", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.899 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.901 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.902 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.903 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.905 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.906 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.907 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.908 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "password": { 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "password", 2023-11-24T06:15:00.909 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "password of InfluxDB server user", 2023-11-24T06:15:00.910 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "port": { 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "port", 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.911 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "8086", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "InfluxDB server port", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.912 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "ssl": { 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "ssl", 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "false", 2023-11-24T06:15:00.913 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "threads": { 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "threads", 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:00.915 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "32", 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "username": { 2023-11-24T06:15:00.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "username", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.917 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "username of InfluxDB server user", 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "verify_ssl": { 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "verify_ssl", 2023-11-24T06:15:00.918 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "true", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-11-24T06:15:00.919 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "insights", 2023-11-24T06:15:00.920 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.921 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.922 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.924 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.925 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.926 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.927 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.928 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.929 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "iostat", 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.930 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.931 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.932 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.933 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.934 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.936 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.937 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.938 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.939 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "localpool", 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.940 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "failure_domain": { 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "failure_domain", 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "host", 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.941 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "failure domain for any created local pool", 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.942 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.943 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.944 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.945 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.946 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.947 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.948 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.950 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "min_size": { 2023-11-24T06:15:00.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "min_size", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.952 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default min_size for any created local pool", 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "num_rep": { 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "num_rep", 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.953 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3", 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default replica count for any created local pool", 2023-11-24T06:15:00.954 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_num": { 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pg_num", 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.955 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "128", 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "default pg_num for any created local pool", 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.956 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "prefix": { 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prefix", 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.957 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "name prefix for any created local pool", 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "subtree": { 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "subtree", 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "rack", 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.959 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "CRUSH level for which to create a local pool", 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mds_autoscaler", 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.961 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.962 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.963 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.964 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.965 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.966 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.967 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.969 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.970 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mirroring", 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.971 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.972 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.973 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.974 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.975 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.976 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.977 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.979 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "nfs", 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.981 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.982 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.983 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.984 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.985 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.986 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.987 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.988 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.989 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "orchestrator", 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "fail_fs": { 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "fail_fs", 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.991 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.992 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.993 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.994 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.995 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.996 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:00.997 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:00.998 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:00.999 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.000 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator": { 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "orchestrator", 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "cephadm", 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "rook", 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "test_orchestrator" 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Orchestrator backend", 2023-11-24T06:15:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "osd_perf_query", 2023-11-24T06:15:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "osd_support", 2023-11-24T06:15:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "pg_autoscaler", 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.026 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.027 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.028 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.030 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.031 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.032 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.033 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:01.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.035 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "threshold": { 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "threshold", 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.036 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "3.0", 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1.0", 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "scaling threshold", 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.037 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "progress", 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.038 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_pg_recovery_event": { 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_pg_recovery_event", 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.039 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow the module to show pg recovery progress", 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "enabled": { 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enabled", 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.041 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.042 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.043 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.044 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.045 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.046 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.047 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.048 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.050 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.051 INFO:teuthology.orchestra.run.smithi106.stdout: "max_completed_events": { 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_completed_events", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "50", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.052 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "number of past completed events to remember", 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "sleep_interval": { 2023-11-24T06:15:01.053 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "sleep_interval", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "5", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.054 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "how long the module is going to sleep", 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.055 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "prometheus", 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "cache": { 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "cache", 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.056 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.057 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "exclude_perf_counters": { 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "exclude_perf_counters", 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.058 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.060 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.061 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.062 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.063 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.064 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.065 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.066 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.067 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_stats_pools": { 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_stats_pools", 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.069 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_stats_pools_refresh_interval": { 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "300", 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.071 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "scrape_interval": { 2023-11-24T06:15:01.072 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "scrape_interval", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15.0", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.073 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:01.074 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "::", 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.075 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.076 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "9283", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.077 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "stale_cache_strategy": { 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "stale_cache_strategy", 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.078 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "log", 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_behaviour": { 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_behaviour", 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "default", 2023-11-24T06:15:01.080 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "default", 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "error" 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.081 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "standby_error_status_code": { 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "standby_error_status_code", 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.082 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "500", 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "400", 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "599", 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.083 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_support", 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.084 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.085 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.086 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.087 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.088 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.089 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.090 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.091 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.092 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.093 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "max_concurrent_snap_create": { 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_concurrent_snap_create", 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.094 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10", 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.095 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "mirror_snapshot_schedule": { 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "mirror_snapshot_schedule", 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.096 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "trash_purge_schedule": { 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "trash_purge_schedule", 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.098 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "restful", 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.100 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "enable_auth": { 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enable_auth", 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.101 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "key_file": { 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "key_file", 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.103 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.104 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.105 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.106 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.107 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.108 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.110 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.111 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.112 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.113 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "server_addr": { 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_addr", 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.114 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.115 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "server_port": { 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "server_port", 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.116 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rgw", 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.118 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.119 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.120 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.121 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.122 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.124 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.125 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.126 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.127 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rook", 2023-11-24T06:15:01.128 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "drive_group_interval": { 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "drive_group_interval", 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.129 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "300.0", 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.130 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.131 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.132 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.134 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.135 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.136 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.137 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.138 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.139 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "storage_class": { 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "storage_class", 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.140 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "local", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.141 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "selftest", 2023-11-24T06:15:01.142 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.143 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.144 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.146 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.147 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.148 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.149 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.150 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.151 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "roption1": { 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "roption1", 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.152 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "roption2": { 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "roption2", 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "xyz", 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.154 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption1": { 2023-11-24T06:15:01.155 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption1", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.156 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption2": { 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption2", 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.157 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.158 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption3": { 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption3", 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "float", 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.159 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.160 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption4": { 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption4", 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.162 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption5": { 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption5", 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.163 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption6": { 2023-11-24T06:15:01.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption6", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.165 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "rwoption7": { 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rwoption7", 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.166 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "1", 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "42", 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.167 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "testkey": { 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testkey", 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.168 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.169 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "testlkey": { 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testlkey", 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "testnewline": { 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "testnewline", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.172 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "snap_schedule", 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "allow_m_granularity": { 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "allow_m_granularity", 2023-11-24T06:15:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "allow minute scheduled snapshots", 2023-11-24T06:15:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "dump_on_update": { 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "dump_on_update", 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "dump database to debug log on update", 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "stats", 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "status", 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.202 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.203 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.204 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.205 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.206 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "telegraf", 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.207 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "address": { 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "address", 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-11-24T06:15:01.208 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.209 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "15", 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.210 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.212 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.213 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.214 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.215 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.216 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.217 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.218 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.219 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "telemetry", 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_basic": { 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_basic", 2023-11-24T06:15:01.221 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.222 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share basic cluster information (size, version)", 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_crash": { 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_crash", 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.223 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.224 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_device": { 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_device", 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.225 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "True", 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.226 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_ident": { 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_ident", 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.227 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "channel_perf": { 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "channel_perf", 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.229 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Share various performance metrics of a cluster", 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "contact": { 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "contact", 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.231 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.232 INFO:teuthology.orchestra.run.smithi106.stdout: "description": { 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "description", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.233 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "device_url": { 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "device_url", 2023-11-24T06:15:01.234 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.235 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "enabled": { 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "enabled", 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.236 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.237 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "24", 2023-11-24T06:15:01.238 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "8", 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.241 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "last_opt_revision": { 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "last_opt_revision", 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "1", 2023-11-24T06:15:01.242 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.243 INFO:teuthology.orchestra.run.smithi106.stdout: "leaderboard": { 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "leaderboard", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.244 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "leaderboard_description": { 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "leaderboard_description", 2023-11-24T06:15:01.245 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.246 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.247 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.248 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.250 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.251 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.252 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.253 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.254 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.255 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "organization": { 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "organization", 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.256 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.257 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "proxy": { 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "proxy", 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.258 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.259 INFO:teuthology.orchestra.run.smithi106.stdout: "url": { 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "url", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.260 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "test_orchestrator", 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.263 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.264 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.265 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.266 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.267 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.268 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.269 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.270 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "volumes", 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.273 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.274 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.275 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.276 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.277 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.278 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.279 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.280 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "max_concurrent_clones": { 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "max_concurrent_clones", 2023-11-24T06:15:01.281 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "4", 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.282 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Number of asynchronous cloner threads", 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "periodic_async_work": { 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "periodic_async_work", 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.283 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Periodically check for async work", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.284 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "snapshot_clone_delay": { 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "snapshot_clone_delay", 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.285 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "0", 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.286 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix", 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: "can_run": true, 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: "error_string": "", 2023-11-24T06:15:01.287 INFO:teuthology.orchestra.run.smithi106.stdout: "module_options": { 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "discovery_interval": { 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "discovery_interval", 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "uint", 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "100", 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.288 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "identifier": { 2023-11-24T06:15:01.289 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "identifier", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.290 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "interval": { 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "interval", 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "secs", 2023-11-24T06:15:01.291 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "60", 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.292 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "log_level": { 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_level", 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.293 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.294 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster": { 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster", 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.296 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_cluster_level": { 2023-11-24T06:15:01.297 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_cluster_level", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "info", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [ 2023-11-24T06:15:01.298 INFO:teuthology.orchestra.run.smithi106.stdout: "", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "critical", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "debug", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "error", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "info", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "warning" 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.299 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "log_to_file": { 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "log_to_file", 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "bool", 2023-11-24T06:15:01.300 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 1, 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "False", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.301 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_host": { 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_host", 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.302 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "", 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.303 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_port": { 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_port", 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "int", 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.304 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "10051", 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "zabbix_sender": { 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "zabbix_sender", 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "str", 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "level": "advanced", 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "flags": 0, 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "min": "", 2023-11-24T06:15:01.306 INFO:teuthology.orchestra.run.smithi106.stdout: "max": "", 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: "enum_allowed": [], 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: "desc": "", 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: "long_desc": "", 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: "tags": [], 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: "see_also": [] 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "services": {}, 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "always_on_modules": { 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus": [ 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "balancer", 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "crash", 2023-11-24T06:15:01.308 INFO:teuthology.orchestra.run.smithi106.stdout: "devicehealth", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscaler", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "progress", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_support", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "status", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "telemetry", 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: "volumes" 2023-11-24T06:15:01.309 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific": [ 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "balancer", 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "crash", 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "devicehealth", 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator", 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscaler", 2023-11-24T06:15:01.310 INFO:teuthology.orchestra.run.smithi106.stdout: "progress", 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_support", 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "status", 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "telemetry", 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "volumes" 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy": [ 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "balancer", 2023-11-24T06:15:01.311 INFO:teuthology.orchestra.run.smithi106.stdout: "crash", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "devicehealth", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscaler", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "progress", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_support", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "status", 2023-11-24T06:15:01.312 INFO:teuthology.orchestra.run.smithi106.stdout: "telemetry", 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "volumes" 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "reef": [ 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "balancer", 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "crash", 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "devicehealth", 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "orchestrator", 2023-11-24T06:15:01.313 INFO:teuthology.orchestra.run.smithi106.stdout: "pg_autoscaler", 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: "progress", 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: "rbd_support", 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: "status", 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: "telemetry", 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: "volumes" 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "last_failure_osd_epoch": 0, 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "active_clients": [ 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "devicehealth", 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2023-11-24T06:15:01.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 208358901 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "libcephsqlite", 2023-11-24T06:15:01.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 544400408 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "rbd_support", 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1035490608 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.318 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "volumes", 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v2", 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2023-11-24T06:15:01.319 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 15949128 2023-11-24T06:15:01.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2023-11-24T06:15:01.320 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 msgr2=0x7fc4e406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 0x7fc4e406d3c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc50015e300 tx=0x7fc4fc008040 comp rx=0 tx=0).stop 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 msgr2=0x7fc50013ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c180 tx=0x7fc4f0001120 comp rx=0 tx=0).stop 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 shutdown_connections 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc4e406af00 0x7fc4e406d3c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.322 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc500159390 0x7fc500159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ec003a00 0x7fc50013ffe0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 --2- 172.21.15.106:0/3308682959 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc500143e10 0x7fc5000b13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 >> 172.21.15.106:0/3308682959 conn(0x7fc5000cd570 msgr2=0x7fc50015cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 shutdown_connections 2023-11-24T06:15:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:14:59.753+0000 7fc507efd700 1 -- 172.21.15.106:0/3308682959 wait complete. 2023-11-24T06:15:01.327 DEBUG:tasks.check_counter:Getting stats from y 2023-11-24T06:15:01.327 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.y.asok perf dump 2023-11-24T06:15:01.467 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:01.468 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-0": { 2023-11-24T06:15:01.468 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 171, 2023-11-24T06:15:01.468 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 63, 2023-11-24T06:15:01.469 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 2238144, 2023-11-24T06:15:01.469 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 91520, 2023-11-24T06:15:01.469 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 55, 2023-11-24T06:15:01.470 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 12, 2023-11-24T06:15:01.470 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.037329126, 2023-11-24T06:15:01.470 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.001622465, 2023-11-24T06:15:01.470 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.029615418, 2023-11-24T06:15:01.470 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-11-24T06:15:01.471 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T06:15:01.471 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 48, 2023-11-24T06:15:01.471 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.007090570, 2023-11-24T06:15:01.471 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000147720 2023-11-24T06:15:01.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.472 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2023-11-24T06:15:01.472 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.472 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.472 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.473 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 2238144, 2023-11-24T06:15:01.473 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 91520 2023-11-24T06:15:01.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.473 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-1": { 2023-11-24T06:15:01.473 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 572, 2023-11-24T06:15:01.474 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 333, 2023-11-24T06:15:01.474 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 3481218, 2023-11-24T06:15:01.474 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 3200573, 2023-11-24T06:15:01.474 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 98, 2023-11-24T06:15:01.474 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 16, 2023-11-24T06:15:01.475 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.086028321, 2023-11-24T06:15:01.475 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.022823845, 2023-11-24T06:15:01.475 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.079624972, 2023-11-24T06:15:01.475 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.000020738, 2023-11-24T06:15:01.476 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T06:15:01.476 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 324, 2023-11-24T06:15:01.476 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.243614331, 2023-11-24T06:15:01.476 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000751896 2023-11-24T06:15:01.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.477 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2023-11-24T06:15:01.477 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.477 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.477 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.478 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 3480336, 2023-11-24T06:15:01.478 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 3200064 2023-11-24T06:15:01.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.478 INFO:teuthology.orchestra.run.smithi106.stdout: "AsyncMessenger::Worker-2": { 2023-11-24T06:15:01.478 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_messages": 376, 2023-11-24T06:15:01.479 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages": 213, 2023-11-24T06:15:01.479 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_bytes": 1953088, 2023-11-24T06:15:01.479 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_bytes": 3609552, 2023-11-24T06:15:01.479 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_created_connections": 145, 2023-11-24T06:15:01.479 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_active_connections": 18, 2023-11-24T06:15:01.480 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_total_time": 0.080095506, 2023-11-24T06:15:01.480 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_send_time": 0.006116327, 2023-11-24T06:15:01.480 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_recv_time": 0.073217377, 2023-11-24T06:15:01.480 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_running_fast_dispatch_time": 0.003242818, 2023-11-24T06:15:01.480 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_messages_queue_lat": { 2023-11-24T06:15:01.481 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 205, 2023-11-24T06:15:01.481 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.015958086, 2023-11-24T06:15:01.481 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000077844 2023-11-24T06:15:01.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.481 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_handle_ack_lat": { 2023-11-24T06:15:01.482 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.482 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.482 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.482 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_recv_encrypted_bytes": 1953088, 2023-11-24T06:15:01.483 INFO:teuthology.orchestra.run.smithi106.stdout: "msgr_send_encrypted_bytes": 3609552 2023-11-24T06:15:01.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.483 INFO:teuthology.orchestra.run.smithi106.stdout: "cct": { 2023-11-24T06:15:01.483 INFO:teuthology.orchestra.run.smithi106.stdout: "total_workers": 0, 2023-11-24T06:15:01.483 INFO:teuthology.orchestra.run.smithi106.stdout: "unhealthy_workers": 0 2023-11-24T06:15:01.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.484 INFO:teuthology.orchestra.run.smithi106.stdout: "client": { 2023-11-24T06:15:01.484 INFO:teuthology.orchestra.run.smithi106.stdout: "reply": { 2023-11-24T06:15:01.484 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.485 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.485 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.485 INFO:teuthology.orchestra.run.smithi106.stdout: "lat": { 2023-11-24T06:15:01.485 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.486 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.486 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.486 INFO:teuthology.orchestra.run.smithi106.stdout: "wrlat": { 2023-11-24T06:15:01.486 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.487 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.487 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.487 INFO:teuthology.orchestra.run.smithi106.stdout: "rdlat": { 2023-11-24T06:15:01.488 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.488 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.488 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.488 INFO:teuthology.orchestra.run.smithi106.stdout: "fsync": { 2023-11-24T06:15:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.489 INFO:teuthology.orchestra.run.smithi106.stdout: "mdavg": 0.000000000, 2023-11-24T06:15:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: "mdsqsum": 0, 2023-11-24T06:15:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: "mdops": 0, 2023-11-24T06:15:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: "readavg": 0.000000000, 2023-11-24T06:15:01.490 INFO:teuthology.orchestra.run.smithi106.stdout: "readsqsum": 0, 2023-11-24T06:15:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: "rdops": 0, 2023-11-24T06:15:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: "writeavg": 0.000000000, 2023-11-24T06:15:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: "writesqsum": 0, 2023-11-24T06:15:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: "rdops": 0 2023-11-24T06:15:01.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.492 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-Mgr": { 2023-11-24T06:15:01.492 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.492 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.492 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2, 2023-11-24T06:15:01.492 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.048232357, 2023-11-24T06:15:01.493 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.024116178 2023-11-24T06:15:01.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.493 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-MgrStandby": { 2023-11-24T06:15:01.493 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.494 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.494 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.494 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.494 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.495 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-balancer": { 2023-11-24T06:15:01.495 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.495 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.496 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.496 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.496 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.497 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-cmd_finisher": { 2023-11-24T06:15:01.497 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.497 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.497 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 17, 2023-11-24T06:15:01.498 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000679933, 2023-11-24T06:15:01.498 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000039996 2023-11-24T06:15:01.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.498 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-crash": { 2023-11-24T06:15:01.499 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.499 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.499 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.499 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.499 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.500 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-devicehealth": { 2023-11-24T06:15:01.500 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.501 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-iostat": { 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-nfs": { 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.504 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-orchestrator": { 2023-11-24T06:15:01.504 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.504 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.504 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.504 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-pg_autoscaler": { 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.505 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.506 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-progress": { 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-rbd_support": { 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.508 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-restful": { 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 16, 2023-11-24T06:15:01.509 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.002602068, 2023-11-24T06:15:01.510 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000162629 2023-11-24T06:15:01.510 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.510 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-status": { 2023-11-24T06:15:01.511 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.511 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.511 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.511 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.511 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.512 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.512 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.512 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-telemetry": { 2023-11-24T06:15:01.512 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.512 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.513 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.513 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.513 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.513 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.513 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.514 INFO:teuthology.orchestra.run.smithi106.stdout: "finisher-volumes": { 2023-11-24T06:15:01.514 INFO:teuthology.orchestra.run.smithi106.stdout: "queue_len": 0, 2023-11-24T06:15:01.514 INFO:teuthology.orchestra.run.smithi106.stdout: "complete_latency": { 2023-11-24T06:15:01.514 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1, 2023-11-24T06:15:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000463987, 2023-11-24T06:15:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000463987 2023-11-24T06:15:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.515 INFO:teuthology.orchestra.run.smithi106.stdout: "libcephsqlite_striper": { 2023-11-24T06:15:01.516 INFO:teuthology.orchestra.run.smithi106.stdout: "update_metadata": 8, 2023-11-24T06:15:01.516 INFO:teuthology.orchestra.run.smithi106.stdout: "update_allocated": 2, 2023-11-24T06:15:01.516 INFO:teuthology.orchestra.run.smithi106.stdout: "update_size": 6, 2023-11-24T06:15:01.516 INFO:teuthology.orchestra.run.smithi106.stdout: "update_version": 8, 2023-11-24T06:15:01.516 INFO:teuthology.orchestra.run.smithi106.stdout: "shrink": 0, 2023-11-24T06:15:01.517 INFO:teuthology.orchestra.run.smithi106.stdout: "shrink_bytes": 0, 2023-11-24T06:15:01.517 INFO:teuthology.orchestra.run.smithi106.stdout: "lock": 11, 2023-11-24T06:15:01.517 INFO:teuthology.orchestra.run.smithi106.stdout: "unlock": 11 2023-11-24T06:15:01.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.517 INFO:teuthology.orchestra.run.smithi106.stdout: "libcephsqlite_vfs": { 2023-11-24T06:15:01.518 INFO:teuthology.orchestra.run.smithi106.stdout: "op_open": { 2023-11-24T06:15:01.518 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 2, 2023-11-24T06:15:01.518 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.189995515, 2023-11-24T06:15:01.518 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.094997757 2023-11-24T06:15:01.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.519 INFO:teuthology.orchestra.run.smithi106.stdout: "op_delete": { 2023-11-24T06:15:01.519 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.519 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.519 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: "op_access": { 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.520 INFO:teuthology.orchestra.run.smithi106.stdout: "op_fullpathname": { 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1, 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: "op_currenttime": { 2023-11-24T06:15:01.521 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 4, 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_close": { 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.522 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_read": { 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 20, 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.011999717, 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000599985 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.523 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_write": { 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 85, 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.008999786, 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000105879 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_truncate": { 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.524 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_sync": { 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 24, 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.074998231, 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003124926 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_filesize": { 2023-11-24T06:15:01.525 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 20, 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_lock": { 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 27, 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.026999364, 2023-11-24T06:15:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000999976 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_unlock": { 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 19, 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.018999549, 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000999976 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_checkreservedlock": { 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 9, 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_filecontrol": { 2023-11-24T06:15:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 26, 2023-11-24T06:15:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_sectorsize": { 2023-11-24T06:15:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "opf_devicecharacteristics": { 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 30, 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "mempool": { 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_bytes": 0, 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "bloom_filter_items": 0, 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_bytes": 0, 2023-11-24T06:15:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_alloc_items": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_bytes": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_data_items": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_bytes": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_onode_items": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_bytes": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_meta_items": 0, 2023-11-24T06:15:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_bytes": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_other_items": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_bytes": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_cache_buffer_items": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_bytes": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_extent_items": 0, 2023-11-24T06:15:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_bytes": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_blob_items": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_bytes": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_shared_blob_items": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_bytes": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_inline_bl_items": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_bytes": 0, 2023-11-24T06:15:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_fsck_items": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_bytes": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_txc_items": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_bytes": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_deferred_items": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_bytes": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluestore_writing_items": 0, 2023-11-24T06:15:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_bytes": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_items": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_bytes": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_reader_items": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_bytes": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "bluefs_file_writer_items": 0, 2023-11-24T06:15:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_bytes": 1616077, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_anon_items": 278, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_bytes": 1496, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "buffer_meta_items": 17, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_bytes": 0, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_items": 0, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_bytes": 0, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_mapbl_items": 0, 2023-11-24T06:15:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_bytes": 0, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_pglog_items": 0, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_bytes": 32344, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_items": 569, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_bytes": 0, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap_mapping_items": 0, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_bytes": 12920, 2023-11-24T06:15:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "pgmap_items": 313, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_bytes": 0, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_co_items": 0, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_bytes": 0, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_1_items": 0, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_bytes": 0, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "unittest_2_items": 0 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": { 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_hit": 0, 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_miss": 0 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "objectcacher-libcephfs": { 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_ops_hit": 0, 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_ops_miss": 0, 2023-11-24T06:15:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_bytes_hit": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "cache_bytes_miss": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "data_read": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "data_written": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "data_flushed": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "data_overwritten_while_flushing": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "write_ops_blocked": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "write_bytes_blocked": 0, 2023-11-24T06:15:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "write_time_blocked": 0.000000000 2023-11-24T06:15:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter": { 2023-11-24T06:15:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2023-11-24T06:15:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2023-11-24T06:15:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 0, 2023-11-24T06:15:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 0, 2023-11-24T06:15:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 0, 2023-11-24T06:15:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 0, 2023-11-24T06:15:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2023-11-24T06:15:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2023-11-24T06:15:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2023-11-24T06:15:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 0, 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 0, 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2023-11-24T06:15:01.546 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2023-11-24T06:15:01.547 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2023-11-24T06:15:01.547 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2023-11-24T06:15:01.547 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2023-11-24T06:15:01.547 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 0, 2023-11-24T06:15:01.547 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2023-11-24T06:15:01.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2023-11-24T06:15:01.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2023-11-24T06:15:01.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2023-11-24T06:15:01.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2023-11-24T06:15:01.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2023-11-24T06:15:01.549 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2023-11-24T06:15:01.549 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2023-11-24T06:15:01.549 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2023-11-24T06:15:01.549 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2023-11-24T06:15:01.549 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 0, 2023-11-24T06:15:01.550 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2023-11-24T06:15:01.550 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2023-11-24T06:15:01.550 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2023-11-24T06:15:01.550 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2023-11-24T06:15:01.550 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2023-11-24T06:15:01.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2023-11-24T06:15:01.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2023-11-24T06:15:01.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T06:15:01.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2023-11-24T06:15:01.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2023-11-24T06:15:01.552 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2023-11-24T06:15:01.552 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2023-11-24T06:15:01.552 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2023-11-24T06:15:01.552 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2023-11-24T06:15:01.552 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2023-11-24T06:15:01.553 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2023-11-24T06:15:01.553 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2023-11-24T06:15:01.554 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2023-11-24T06:15:01.555 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2023-11-24T06:15:01.556 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2023-11-24T06:15:01.556 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 8, 2023-11-24T06:15:01.556 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2023-11-24T06:15:01.556 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 36, 2023-11-24T06:15:01.557 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2023-11-24T06:15:01.557 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 35, 2023-11-24T06:15:01.557 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 8, 2023-11-24T06:15:01.557 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 8, 2023-11-24T06:15:01.557 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2023-11-24T06:15:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2023-11-24T06:15:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2023-11-24T06:15:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2023-11-24T06:15:01.558 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2023-11-24T06:15:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter-0x55b92ba52e60": { 2023-11-24T06:15:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2023-11-24T06:15:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2023-11-24T06:15:01.559 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 163, 2023-11-24T06:15:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 2434716, 2023-11-24T06:15:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 0, 2023-11-24T06:15:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 163, 2023-11-24T06:15:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2023-11-24T06:15:01.560 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 163, 2023-11-24T06:15:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.639984892, 2023-11-24T06:15:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.003926287 2023-11-24T06:15:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2023-11-24T06:15:01.561 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2023-11-24T06:15:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 163, 2023-11-24T06:15:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 307 2023-11-24T06:15:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 163, 2023-11-24T06:15:01.562 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 46, 2023-11-24T06:15:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 117, 2023-11-24T06:15:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2023-11-24T06:15:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2023-11-24T06:15:01.563 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2023-11-24T06:15:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 2, 2023-11-24T06:15:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 20, 2023-11-24T06:15:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 85, 2023-11-24T06:15:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2023-11-24T06:15:01.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2023-11-24T06:15:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2023-11-24T06:15:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2023-11-24T06:15:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2023-11-24T06:15:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2023-11-24T06:15:01.565 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2023-11-24T06:15:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2023-11-24T06:15:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2023-11-24T06:15:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 104, 2023-11-24T06:15:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 52, 2023-11-24T06:15:01.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 22, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 22, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2023-11-24T06:15:01.567 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T06:15:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2023-11-24T06:15:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2023-11-24T06:15:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2023-11-24T06:15:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2023-11-24T06:15:01.568 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2023-11-24T06:15:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2023-11-24T06:15:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2023-11-24T06:15:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2023-11-24T06:15:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2023-11-24T06:15:01.569 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2023-11-24T06:15:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2023-11-24T06:15:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2023-11-24T06:15:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2023-11-24T06:15:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2023-11-24T06:15:01.570 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2023-11-24T06:15:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2023-11-24T06:15:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2023-11-24T06:15:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2023-11-24T06:15:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2023-11-24T06:15:01.571 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 15, 2023-11-24T06:15:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2023-11-24T06:15:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 5, 2023-11-24T06:15:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 1, 2023-11-24T06:15:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 1, 2023-11-24T06:15:01.572 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2023-11-24T06:15:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2023-11-24T06:15:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2023-11-24T06:15:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2023-11-24T06:15:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2023-11-24T06:15:01.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter-0x55b92ba53680": { 2023-11-24T06:15:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2023-11-24T06:15:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2023-11-24T06:15:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 1, 2023-11-24T06:15:01.574 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 39, 2023-11-24T06:15:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 0, 2023-11-24T06:15:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 1, 2023-11-24T06:15:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2023-11-24T06:15:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1, 2023-11-24T06:15:01.575 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.001999952, 2023-11-24T06:15:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.001999952 2023-11-24T06:15:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2023-11-24T06:15:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2023-11-24T06:15:01.576 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 1, 2023-11-24T06:15:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 1 2023-11-24T06:15:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 1, 2023-11-24T06:15:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 1, 2023-11-24T06:15:01.577 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 0, 2023-11-24T06:15:01.578 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2023-11-24T06:15:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2023-11-24T06:15:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2023-11-24T06:15:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2023-11-24T06:15:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2023-11-24T06:15:01.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2023-11-24T06:15:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2023-11-24T06:15:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2023-11-24T06:15:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2023-11-24T06:15:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2023-11-24T06:15:01.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 0, 2023-11-24T06:15:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2023-11-24T06:15:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2023-11-24T06:15:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2023-11-24T06:15:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2023-11-24T06:15:01.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2023-11-24T06:15:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2023-11-24T06:15:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2023-11-24T06:15:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T06:15:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2023-11-24T06:15:01.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2023-11-24T06:15:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 1, 2023-11-24T06:15:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2023-11-24T06:15:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2023-11-24T06:15:01.583 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2023-11-24T06:15:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2023-11-24T06:15:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2023-11-24T06:15:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2023-11-24T06:15:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2023-11-24T06:15:01.584 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2023-11-24T06:15:01.585 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2023-11-24T06:15:01.585 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2023-11-24T06:15:01.585 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2023-11-24T06:15:01.585 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2023-11-24T06:15:01.585 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2023-11-24T06:15:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2023-11-24T06:15:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2023-11-24T06:15:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2023-11-24T06:15:01.586 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 0, 2023-11-24T06:15:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2023-11-24T06:15:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 0, 2023-11-24T06:15:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 1, 2023-11-24T06:15:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 1, 2023-11-24T06:15:01.587 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2023-11-24T06:15:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2023-11-24T06:15:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2023-11-24T06:15:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2023-11-24T06:15:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2023-11-24T06:15:01.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter-0x55b92ba53900": { 2023-11-24T06:15:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2023-11-24T06:15:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2023-11-24T06:15:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 0, 2023-11-24T06:15:01.589 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 0, 2023-11-24T06:15:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 0, 2023-11-24T06:15:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 0, 2023-11-24T06:15:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2023-11-24T06:15:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.590 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2023-11-24T06:15:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2023-11-24T06:15:01.591 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0 2023-11-24T06:15:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 0, 2023-11-24T06:15:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 0, 2023-11-24T06:15:01.592 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2023-11-24T06:15:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2023-11-24T06:15:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2023-11-24T06:15:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2023-11-24T06:15:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2023-11-24T06:15:01.593 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 0, 2023-11-24T06:15:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2023-11-24T06:15:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2023-11-24T06:15:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2023-11-24T06:15:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2023-11-24T06:15:01.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2023-11-24T06:15:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2023-11-24T06:15:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2023-11-24T06:15:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2023-11-24T06:15:01.595 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2023-11-24T06:15:01.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2023-11-24T06:15:01.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2023-11-24T06:15:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2023-11-24T06:15:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2023-11-24T06:15:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2023-11-24T06:15:01.598 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2023-11-24T06:15:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2023-11-24T06:15:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2023-11-24T06:15:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2023-11-24T06:15:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2023-11-24T06:15:01.599 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2023-11-24T06:15:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2023-11-24T06:15:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2023-11-24T06:15:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2023-11-24T06:15:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2023-11-24T06:15:01.600 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2023-11-24T06:15:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2023-11-24T06:15:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2023-11-24T06:15:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2023-11-24T06:15:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 0, 2023-11-24T06:15:01.601 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2023-11-24T06:15:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 0, 2023-11-24T06:15:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 0, 2023-11-24T06:15:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 0, 2023-11-24T06:15:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2023-11-24T06:15:01.602 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2023-11-24T06:15:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2023-11-24T06:15:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2023-11-24T06:15:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2023-11-24T06:15:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.603 INFO:teuthology.orchestra.run.smithi106.stdout: "objecter-0x55b92ba53b80": { 2023-11-24T06:15:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "op_active": 0, 2023-11-24T06:15:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "op_laggy": 0, 2023-11-24T06:15:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send": 0, 2023-11-24T06:15:01.604 INFO:teuthology.orchestra.run.smithi106.stdout: "op_send_bytes": 0, 2023-11-24T06:15:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "op_resend": 0, 2023-11-24T06:15:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "op_reply": 0, 2023-11-24T06:15:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "op_latency": { 2023-11-24T06:15:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.605 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "op_inflight": 0, 2023-11-24T06:15:01.606 INFO:teuthology.orchestra.run.smithi106.stdout: "oplen_avg": { 2023-11-24T06:15:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0 2023-11-24T06:15:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "op": 0, 2023-11-24T06:15:01.607 INFO:teuthology.orchestra.run.smithi106.stdout: "op_r": 0, 2023-11-24T06:15:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "op_w": 0, 2023-11-24T06:15:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "op_rmw": 0, 2023-11-24T06:15:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "op_pg": 0, 2023-11-24T06:15:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_stat": 0, 2023-11-24T06:15:01.608 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_create": 0, 2023-11-24T06:15:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_read": 0, 2023-11-24T06:15:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_write": 0, 2023-11-24T06:15:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writefull": 0, 2023-11-24T06:15:01.609 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_writesame": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_append": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_zero": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_truncate": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_delete": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_mapext": 0, 2023-11-24T06:15:01.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_sparse_read": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_clonerange": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_getxattr": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_setxattr": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_cmpxattr": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_rmxattr": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_resetxattrs": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_call": 0, 2023-11-24T06:15:01.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_watch": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_notify": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_src_cmpxattr": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_pgls_filter": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdop_other": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_active": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_send": 0, 2023-11-24T06:15:01.612 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_resend": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "linger_ping": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_active": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_send": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolop_resend": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_active": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_send": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "poolstat_resend": 0, 2023-11-24T06:15:01.613 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_active": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_send": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "statfs_resend": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "command_active": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "command_send": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "command_resend": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "map_epoch": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "map_full": 0, 2023-11-24T06:15:01.614 INFO:teuthology.orchestra.run.smithi106.stdout: "map_inc": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_sessions": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_open": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_session_close": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_laggy": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_wr": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_rd": 0, 2023-11-24T06:15:01.615 INFO:teuthology.orchestra.run.smithi106.stdout: "omap_del": 0 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_client_bytes": { 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 134217728, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 49, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 164080, 2023-11-24T06:15:01.616 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 49, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 49, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 164080, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.617 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_client_messages": { 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 512, 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.618 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 49, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 49, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 49, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 49, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 49, 2023-11-24T06:15:01.619 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_mds_bytes": { 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.620 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 134217728, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 84, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 811610, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 84, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.621 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 84, 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 811610, 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.622 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_mds_messsages": { 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 128, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 84, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 84, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 84, 2023-11-24T06:15:01.623 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 84, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 84, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_mon_bytes": { 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 134217728, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 63, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 454094, 2023-11-24T06:15:01.625 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 63, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 63, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 454094, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.626 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_mon_messsages": { 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 128, 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.627 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 63, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 63, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 63, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 63, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 63, 2023-11-24T06:15:01.628 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_osd_bytes": { 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.629 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 536870912, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 344, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 4242624, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 344, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.630 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 344, 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 4242624, 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.631 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-mgr_osd_messsages": { 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 8192, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 344, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 344, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 344, 2023-11-24T06:15:01.632 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 344, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 344, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.633 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 355, 2023-11-24T06:15:01.634 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 673531, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 355, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 355, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 673531, 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.635 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-mgr-0x55b927a63d60": { 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.636 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 540, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 5672408, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 540, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 540, 2023-11-24T06:15:01.637 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 5672408, 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2023-11-24T06:15:01.638 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 174, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 356880, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 174, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.639 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 174, 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 356880, 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b92ba53ae0": { 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 9, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 314711, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.641 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 9, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 9, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 314711, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.642 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b92bca0780": { 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 8, 2023-11-24T06:15:01.643 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 184480, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 8, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 8, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 184480, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.644 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x55b92bca0b40": { 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.645 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 10, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 314735, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 10, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 10, 2023-11-24T06:15:01.646 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 314735, 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.647 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes": { 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.648 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes-0x55b92ba52d20": { 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 163, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 2433027, 2023-11-24T06:15:01.650 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 163, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 163, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 2433027, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.651 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes-0x55b92ba53a40": { 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.652 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.653 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes-0x55b92bca06e0": { 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.654 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 1, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 1, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.655 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 1, 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.656 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_bytes-0x55b92bca0be0": { 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 104857600, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.657 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.658 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops": { 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.659 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.660 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops-0x55b92ba52dc0": { 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.661 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 163, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 163, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 163, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.662 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 163, 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 163, 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.663 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops-0x55b92ba539a0": { 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.664 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.665 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops-0x55b92bca0c80": { 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 0, 2023-11-24T06:15:01.666 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 0, 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.667 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "throttle-objecter_ops-0x55b92bca0f00": { 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "val": 0, 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "max": 1024, 2023-11-24T06:15:01.668 INFO:teuthology.orchestra.run.smithi106.stdout: "get_started": 0, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "get": 1, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "get_sum": 1, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_fail": 0, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "get_or_fail_success": 1, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "take": 0, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "take_sum": 0, 2023-11-24T06:15:01.669 INFO:teuthology.orchestra.run.smithi106.stdout: "put": 1, 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: "put_sum": 1, 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: "wait": { 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: "avgcount": 0, 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: "sum": 0.000000000, 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: "avgtime": 0.000000000 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2023-11-24T06:15:01.670 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:01.672 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.complete_latency.avgcount=1 2023-11-24T06:15:01.672 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.queue_len=0 2023-11-24T06:15:01.672 ERROR:teuthology.run_tasks:Manager failed: check-counter Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_2442239d2653456406c25ae0c71b689c8f2657b6/teuthology/task/__init__.py", line 132, in __exit__ self.end() File "/home/teuthworker/src/git.ceph.com_ceph-c_a13ea5ff00cb4df7a9cc941166ddeb358881144c/qa/tasks/check_counter.py", line 125, in end raise RuntimeError("The following counters failed to be set " RuntimeError: The following counters failed to be set on mgr daemons: {'finisher-volumes.complete_latency.avgcount'} 2023-11-24T06:15:01.677 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-11-24T06:15:01.687 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T06:15:01.687 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:15:01.687 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:01.709 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T06:15:01.709 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:15:01.709 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:01.769 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-11-24T06:15:01.769 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:15:01.769 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:01.790 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1477 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T06:15:01.790 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:15:01.791 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:01.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1477 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-11-24T06:15:01.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:01.851 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:15:01.870 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-11-24T06:15:01.870 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-24T06:15:01.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:01.871 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-11-24T06:15:01.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:01.953 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-24T06:15:02.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.128 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:15:02.146 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.146 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.217 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:02.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:02.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.219 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:15:02.241 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-11-24T06:15:02.241 INFO:teuthology.orchestra.run.smithi176.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-11-24T06:15:02.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.242 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-11-24T06:15:02.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.330 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-11-24T06:15:02.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.431 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.528 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:15:02.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.545 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.614 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:02.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:02.617 INFO:tasks.kclient:Unmounting kernel clients... 2023-11-24T06:15:02.617 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:15:02.618 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:02.639 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-11-24T06:15:02.639 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2023-11-24T06:15:02.640 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:02.698 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2846 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-11-24T06:15:02.699 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:15:02.699 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:02.719 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1477 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-11-24T06:15:02.720 DEBUG:teuthology.orchestra.run.smithi176:> set -ex 2023-11-24T06:15:02.720 DEBUG:teuthology.orchestra.run.smithi176:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-24T06:15:02.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1477 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-11-24T06:15:02.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.777 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:15:02.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.796 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.865 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:02.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:02.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.867 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2023-11-24T06:15:02.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2023-11-24T06:15:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:02.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:02.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:02.995 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:15:03.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:03.013 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:15:03.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:03.083 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:03.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:03.084 DEBUG:teuthology.orchestra.run.smithi176:> ip netns list 2023-11-24T06:15:03.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-24T06:15:03.140 DEBUG:teuthology.orchestra.run.smithi176:> sudo ip link delete ceph-brx 2023-11-24T06:15:03.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:03.211 INFO:teuthology.orchestra.run.smithi176.stderr:Cannot find device "ceph-brx" 2023-11-24T06:15:03.211 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-11-24T06:15:03.221 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-24T06:15:03.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:03.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.340+0000 7f2dece2c700 1 Processor -- start 2023-11-24T06:15:03.343 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.340+0000 7f2dece2c700 1 -- start start 2023-11-24T06:15:03.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2dece2c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2de81603d0 0x7f2de815f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.345 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2dece2c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f2de815fd70 0x7f2de8070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2dece2c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2de8070ac0 con 0x7f2de8145740 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2dece2c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de8160180 con 0x7f2de81603d0 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2dece2c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2de806d670 con 0x7f2de815fd70 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2de5d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2de81603d0 0x7f2de815f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2de5d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2de81603d0 0x7f2de815f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60404/0 (socket says 172.21.15.106:60404) 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2de5d9b700 1 -- 172.21.15.106:0/2265062596 learned_addr learned my addr 172.21.15.106:0/2265062596 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.341+0000 7f2de6d9d700 1 --2- 172.21.15.106:0/2265062596 >> v2:172.21.15.176:3300/0 conn(0x7f2de815fd70 0x7f2de8070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de5d9b700 1 -- 172.21.15.106:0/2265062596 >> v2:172.21.15.176:3300/0 conn(0x7f2de815fd70 msgr2=0x7f2de8070f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de5d9b700 1 --2- 172.21.15.106:0/2265062596 >> v2:172.21.15.176:3300/0 conn(0x7f2de815fd70 0x7f2de8070f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de5d9b700 1 -- 172.21.15.106:0/2265062596 >> v1:172.21.15.176:6789/0 conn(0x7f2de8145740 legacy=0x7f2de806e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de5d9b700 1 -- 172.21.15.106:0/2265062596 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de806d950 con 0x7f2de81603d0 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de5d9b700 1 --2- 172.21.15.106:0/2265062596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de81603d0 0x7f2de815f830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b4e90 tx=0x7f2ddc009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad498c12ba1a735 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de559a700 1 -- 172.21.15.106:0/2265062596 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc011830 con 0x7f2de81603d0 2023-11-24T06:15:03.347 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de559a700 1 -- 172.21.15.106:0/2265062596 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc011990 con 0x7f2de81603d0 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2de559a700 1 -- 172.21.15.106:0/2265062596 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc011d20 con 0x7f2de81603d0 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2dece2c700 1 -- 172.21.15.106:0/2265062596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de81603d0 msgr2=0x7f2de815f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.342+0000 7f2dece2c700 1 --2- 172.21.15.106:0/2265062596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de81603d0 0x7f2de815f830 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2de80b4e90 tx=0x7f2ddc009bd0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 -- 172.21.15.106:0/2265062596 shutdown_connections 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 --2- 172.21.15.106:0/2265062596 >> v2:172.21.15.176:3300/0 conn(0x7f2de815fd70 0x7f2de8070f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 --2- 172.21.15.106:0/2265062596 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de81603d0 0x7f2de815f830 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 -- 172.21.15.106:0/2265062596 >> 172.21.15.106:0/2265062596 conn(0x7f2de80b1740 msgr2=0x7f2de80b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 -- 172.21.15.106:0/2265062596 shutdown_connections 2023-11-24T06:15:03.349 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.343+0000 7f2dece2c700 1 -- 172.21.15.106:0/2265062596 wait complete. 2023-11-24T06:15:03.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.344+0000 7f2dece2c700 1 Processor -- start 2023-11-24T06:15:03.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.344+0000 7f2dece2c700 1 -- start start 2023-11-24T06:15:03.351 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de8145740 0x7f2de813a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 0x7f2de81382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de813ae60 con 0x7f2de815fd70 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de813a750 con 0x7f2de81603d0 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2dece2c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2de8139170 con 0x7f2de8145740 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2de5d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2de5d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60408/0 (socket says 172.21.15.106:60408) 2023-11-24T06:15:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.345+0000 7f2de5d9b700 1 -- 172.21.15.106:0/758622494 learned_addr learned my addr 172.21.15.106:0/758622494 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de6d9d700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 0x7f2de81382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 -- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de8145740 msgr2=0x7f2de813a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de659c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de8145740 0x7f2de813a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de8145740 0x7f2de813a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 -- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 msgr2=0x7f2de81382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 0x7f2de81382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 -- 172.21.15.106:0/758622494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc009550 con 0x7f2de815fd70 2023-11-24T06:15:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de6d9d700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 0x7f2de81382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2de5d9b700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009c10 tx=0x7f2ddc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc0036a0 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ddc01e070 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de8139450 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc003a60 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.346+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de8139a10 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.347+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2de80cf8a0 con 0x7f2de815fd70 2023-11-24T06:15:03.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.348+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ddc003bc0 con 0x7f2de815fd70 2023-11-24T06:15:03.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.348+0000 7f2dd6ffd700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 0x7f2dc806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.348+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2ddc08a1a0 con 0x7f2de815fd70 2023-11-24T06:15:03.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.348+0000 7f2de659c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 0x7f2dc806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.348+0000 7f2de659c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 0x7f2dc806d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000f60 tx=0x7f2dd8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.352+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ddc0555e0 con 0x7f2de815fd70 2023-11-24T06:15:03.539 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.536+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2de8074e80 con 0x7f2dc806aed0 2023-11-24T06:15:03.541 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.539+0000 7f2dd6ffd700 1 -- 172.21.15.106:0/758622494 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50270 (secure 0 0 0) 0x7f2de8074e80 con 0x7f2dc806aed0 2023-11-24T06:15:03.542 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 msgr2=0x7f2dc806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 0x7f2dc806d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8000f60 tx=0x7f2dd8009040 comp rx=0 tx=0).stop 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 msgr2=0x7f2de81e6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009c10 tx=0x7f2ddc004750 comp rx=0 tx=0).stop 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 shutdown_connections 2023-11-24T06:15:03.544 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f2dc806aed0 0x7f2dc806d390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f2de81603d0 0x7f2de81382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f2de8145740 0x7f2de813a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 --2- 172.21.15.106:0/758622494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2de815fd70 0x7f2de81e6f70 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 >> 172.21.15.106:0/758622494 conn(0x7f2de80b1740 msgr2=0x7f2de80b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 shutdown_connections 2023-11-24T06:15:03.545 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.541+0000 7f2dece2c700 1 -- 172.21.15.106:0/758622494 wait complete. 2023-11-24T06:15:03.546 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:15:03.555 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":76,"stamp":"2023-11-24T06:15:01.704227+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":220452,"kb_used_data":4288,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754268,"statfs":{"total":773094113280,"available":772868370432,"internally_reserved":0,"allocated":4390912,"data_stored":2441665,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.213590"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:14:57.221254+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:57.221254+0000","last_peered":"2023-11-24T06:14:57.221254+0000","last_clean":"2023-11-24T06:14:57.221254+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:57.221254+0000","last_undegraded":"2023-11-24T06:14:57.221254+0000","last_fullsized":"2023-11-24T06:14:57.221254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343848,"statfs":{"total":96636764160,"available":96608100352,"internally_reserved":0,"allocated":995328,"data_stored":749044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.57199999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.54200000000000004},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.59899999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.624}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.74399999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.65900000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.76700000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.82199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.61299999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.55000000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.746},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.52300000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.375},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.312}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.435}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.59199999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.51800000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343844,"statfs":{"total":96636764160,"available":96608096256,"internally_reserved":0,"allocated":995328,"data_stored":749044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.24199999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.40100000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.32900000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.35699999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.308},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.28299999999999997}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.63600000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574869,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.23799999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.35499999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.33900000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.372}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.76200000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.80700000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.74399999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.58399999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":156096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.26900000000000002},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.318}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.35399999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.378},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.504},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.53400000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.63100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":152777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.378}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.502}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.62},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":401408,"data_stored":158676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.57799999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.79400000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.629}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.67800000000000005}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:03.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:03.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.675+0000 7fb6e1f6a700 1 Processor -- start 2023-11-24T06:15:03.678 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.675+0000 7fb6e1f6a700 1 -- start start 2023-11-24T06:15:03.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6e1f6a700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6e1f6a700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0cfd40 con 0x7fb6dc15b200 2023-11-24T06:15:03.680 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6e1f6a700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6dc0affa0 con 0x7fb6dc0b1a70 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6e1f6a700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6dc0d0020 con 0x7fb6dc15ae20 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60414/0 (socket says 172.21.15.106:60414) 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 -- 172.21.15.106:0/3792569673 learned_addr learned my addr 172.21.15.106:0/3792569673 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6daffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb6dc15b200 0x7fb6dc0b3290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40678/0 (socket says 172.21.15.106:40678) 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 -- 172.21.15.106:0/3792569673 >> v1:172.21.15.176:6789/0 conn(0x7fb6dc0b1a70 legacy=0x7fb6dc164b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 -- 172.21.15.106:0/3792569673 >> v1:172.21.15.106:6789/0 conn(0x7fb6dc15b200 legacy=0x7fb6dc0b3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.681 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6da7fc700 1 -- 172.21.15.106:0/3792569673 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2576748006 0 0) 0x7fb6dc0cfd40 con 0x7fb6dc15b200 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.676+0000 7fb6db7fe700 1 -- 172.21.15.106:0/3792569673 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6dc0b0280 con 0x7fb6dc15ae20 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6db7fe700 1 --2- 172.21.15.106:0/3792569673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00098f0 tx=0x7fb6d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29768f0fa77af6cf server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6da7fc700 1 -- 172.21.15.106:0/3792569673 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000b8a0 con 0x7fb6dc15ae20 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6da7fc700 1 -- 172.21.15.106:0/3792569673 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d000ba00 con 0x7fb6dc15ae20 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6da7fc700 1 -- 172.21.15.106:0/3792569673 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d000bd90 con 0x7fb6dc15ae20 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/3792569673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15ae20 msgr2=0x7fb6dc0b29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.682 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/3792569673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00098f0 tx=0x7fb6d0009c00 comp rx=0 tx=0).stop 2023-11-24T06:15:03.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/3792569673 shutdown_connections 2023-11-24T06:15:03.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/3792569673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc0b29a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/3792569673 >> 172.21.15.106:0/3792569673 conn(0x7fb6dc0b57b0 msgr2=0x7fb6dc0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/3792569673 shutdown_connections 2023-11-24T06:15:03.683 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.677+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/3792569673 wait complete. 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.678+0000 7fb6e1f6a700 1 Processor -- start 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 -- start start 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6dc0b1a70 0x7fb6dc14cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc143430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.686 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc15bf20 con 0x7fb6dc15b200 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc143970 con 0x7fb6dc15ae20 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.679+0000 7fb6e1f6a700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6dc0cce60 con 0x7fb6dc0b1a70 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60424/0 (socket says 172.21.15.106:60424) 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 -- 172.21.15.106:0/912765491 learned_addr learned my addr 172.21.15.106:0/912765491 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6daffd700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.687 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6db7fe700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6dc0b1a70 0x7fb6dc14cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 -- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6dc0b1a70 msgr2=0x7fb6dc14cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6dc0b1a70 0x7fb6dc14cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 -- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6dc15ae20 msgr2=0x7fb6dc143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 -- 172.21.15.106:0/912765491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d0009550 con 0x7fb6dc15b200 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6dbfff700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ee30 tx=0x7fb6d400c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4003a00 con 0x7fb6dc15b200 2023-11-24T06:15:03.688 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d4003b60 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6dc0cd140 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d40050d0 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.680+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6dc15c130 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.681+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6dc067f60 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.682+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6d4005230 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.682+0000 7fb6c3fff700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 0x7fb6c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.682+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb6d408b9c0 con 0x7fb6dc15b200 2023-11-24T06:15:03.689 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.682+0000 7fb6db7fe700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 0x7fb6c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:03.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.682+0000 7fb6db7fe700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 0x7fb6c806d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0000c00 tx=0x7fb6d0008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:03.690 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.686+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb6d4056cf0 con 0x7fb6dc15b200 2023-11-24T06:15:03.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.873+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb6dc0ce500 con 0x7fb6c806aed0 2023-11-24T06:15:03.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.875+0000 7fb6c3fff700 1 -- 172.21.15.106:0/912765491 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50237 (secure 0 0 0) 0x7fb6dc0ce500 con 0x7fb6c806aed0 2023-11-24T06:15:03.878 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:03.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 msgr2=0x7fb6c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 0x7fb6c806d390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0000c00 tx=0x7fb6d0008030 comp rx=0 tx=0).stop 2023-11-24T06:15:03.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 msgr2=0x7fb6dc0cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:03.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fb6d400ee30 tx=0x7fb6d400c550 comp rx=0 tx=0).stop 2023-11-24T06:15:03.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 shutdown_connections 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb6c806aed0 0x7fb6c806d390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6dc15b200 0x7fb6dc0cc580 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb6dc0b1a70 0x7fb6dc14cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 --2- 172.21.15.106:0/912765491 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb6dc15ae20 0x7fb6dc143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 >> 172.21.15.106:0/912765491 conn(0x7fb6dc0b57b0 msgr2=0x7fb6dc0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 shutdown_connections 2023-11-24T06:15:03.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:03.877+0000 7fb6e1f6a700 1 -- 172.21.15.106:0/912765491 wait complete. 2023-11-24T06:15:03.882 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:15:03.892 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-11-24T06:15:03.704540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220612,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754108,"statfs":{"total":773094113280,"available":772868206592,"internally_reserved":0,"allocated":4530176,"data_stored":2494664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001270"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:14:57.221254+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:57.221254+0000","last_peered":"2023-11-24T06:14:57.221254+0000","last_clean":"2023-11-24T06:14:57.221254+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:57.221254+0000","last_undegraded":"2023-11-24T06:14:57.221254+0000","last_fullsized":"2023-11-24T06:14:57.221254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.437}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.309},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.32400000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.372}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.315}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.497},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.433}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.502},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.25700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.441},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.316},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.016},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.621},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.496}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.439},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:03.893 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-24T06:15:03.893 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:04.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.011+0000 7f78c5f17700 1 Processor -- start 2023-11-24T06:15:04.014 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.011+0000 7f78c5f17700 1 -- start start 2023-11-24T06:15:04.017 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78c5f17700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f78c0073f90 0x7f78c0074420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78c5f17700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c006e7f0 con 0x7f78c00ce090 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78c5f17700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c006dec0 con 0x7f78c015e2a0 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78c5f17700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c0074960 con 0x7f78c0073f90 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78beffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f78c00ce090 0x7f78c006ec80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40690/0 (socket says 172.21.15.106:40690) 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78beffd700 1 -- 172.21.15.106:0/962309793 learned_addr learned my addr 172.21.15.106:0/962309793 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 255443113 0 0) 0x7f78c006e7f0 con 0x7f78c00ce090 2023-11-24T06:15:04.018 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78bffff700 1 --2- 172.21.15.106:0/962309793 >> v2:172.21.15.176:3300/0 conn(0x7f78c0073f90 0x7f78c0074420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78ac0035b0 con 0x7f78c00ce090 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2107935857 0 0) 0x7f78ac0035b0 con 0x7f78c00ce090 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 >> v2:172.21.15.176:3300/0 conn(0x7f78c0073f90 msgr2=0x7f78c0074420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 --2- 172.21.15.106:0/962309793 >> v2:172.21.15.176:3300/0 conn(0x7f78c0073f90 0x7f78c0074420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 >> v1:172.21.15.176:6789/0 conn(0x7f78c015e2a0 legacy=0x7f78c006ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c006e1a0 con 0x7f78c00ce090 2023-11-24T06:15:04.019 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.012+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f78a8001670 con 0x7f78c00ce090 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 >> v1:172.21.15.106:6789/0 conn(0x7f78c00ce090 legacy=0x7f78c006ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac003a00 0x7f78ac003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac004850 0x7f78ac004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 0x7f78ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0074960 con 0x7f78ac005210 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac00c1b0 con 0x7f78ac003a00 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78ac00c370 con 0x7f78ac004850 2023-11-24T06:15:04.020 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 0x7f78ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bf7fe700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac003a00 0x7f78ac003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78beffd700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac004850 0x7f78ac004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 -- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac004850 msgr2=0x7f78ac004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac004850 0x7f78ac004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 -- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac003a00 msgr2=0x7f78ac003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78ac003a00 0x7f78ac003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 -- 172.21.15.106:0/962309793 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0035b0 con 0x7f78ac005210 2023-11-24T06:15:04.021 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 -- 172.21.15.106:0/962309793 reap_dead start 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78bffff700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 0x7f78ac00ba10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009fc0 tx=0x7f78ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9965230f982f79de server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003a20 con 0x7f78ac005210 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b800f040 con 0x7f78ac005210 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.013+0000 7f78be7fc700 1 -- 172.21.15.106:0/962309793 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003de0 con 0x7f78ac005210 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 -- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 msgr2=0x7f78ac00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 0x7f78ac00ba10 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f78b8009fc0 tx=0x7f78ac005880 comp rx=0 tx=0).stop 2023-11-24T06:15:04.022 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 -- 172.21.15.106:0/962309793 shutdown_connections 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 --2- 172.21.15.106:0/962309793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78ac005210 0x7f78ac00ba10 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 -- 172.21.15.106:0/962309793 >> 172.21.15.106:0/962309793 conn(0x7f78c00cd570 msgr2=0x7f78c00cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 -- 172.21.15.106:0/962309793 shutdown_connections 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.014+0000 7f78c5f17700 1 -- 172.21.15.106:0/962309793 wait complete. 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.015+0000 7f78c5f17700 1 Processor -- start 2023-11-24T06:15:04.023 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.015+0000 7f78c5f17700 1 -- start start 2023-11-24T06:15:04.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac005210 0x7f78c0161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78c01f3ae0 0x7f78c01f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0159350 con 0x7f78c01f3f60 2023-11-24T06:15:04.026 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c01587d0 con 0x7f78c01f3ae0 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78c5f17700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c0158ab0 con 0x7f78ac005210 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60442/0 (socket says 172.21.15.106:60442) 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 -- 172.21.15.106:0/3758080796 learned_addr learned my addr 172.21.15.106:0/3758080796 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78beffd700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78c01f3ae0 0x7f78c01f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bf7fe700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac005210 0x7f78c0161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 -- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac005210 msgr2=0x7f78c0161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.027 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac005210 0x7f78c0161160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 -- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78c01f3ae0 msgr2=0x7f78c01f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78c01f3ae0 0x7f78c01f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.016+0000 7f78bffff700 1 -- 172.21.15.106:0/3758080796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c0158d90 con 0x7f78c01f3f60 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78bffff700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b3850 tx=0x7f78b8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b8003e90 con 0x7f78c01f3f60 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b8004230 con 0x7f78c01f3f60 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c0159070 con 0x7f78c01f3f60 2023-11-24T06:15:04.028 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b80045e0 con 0x7f78c01f3f60 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.017+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c01563f0 con 0x7f78c01f3f60 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.018+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c0156610 con 0x7f78c01f3f60 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.018+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f78b8004740 con 0x7f78c01f3f60 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.018+0000 7f78b7fff700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 0x7f78a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.019+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f78b808a530 con 0x7f78c01f3f60 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.019+0000 7f78bf7fe700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 0x7f78a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.029 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.019+0000 7f78bf7fe700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 0x7f78a006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78b0007fd0 tx=0x7f78b0009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.030 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.023+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78c0156610 con 0x7f78c01f3f60 2023-11-24T06:15:04.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.209+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78c00ce650 con 0x7f78a006aed0 2023-11-24T06:15:04.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.211+0000 7f78b7fff700 1 -- 172.21.15.106:0/3758080796 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50237 (secure 0 0 0) 0x7f78b00051d0 con 0x7f78a006aed0 2023-11-24T06:15:04.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 msgr2=0x7f78a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 0x7f78a006d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f78b0007fd0 tx=0x7f78b0009040 comp rx=0 tx=0).stop 2023-11-24T06:15:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 msgr2=0x7f78c01f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f78c00b3850 tx=0x7f78b8009750 comp rx=0 tx=0).stop 2023-11-24T06:15:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 shutdown_connections 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f78a006aed0 0x7f78a006d390 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f78c01f3f60 0x7f78c01f3200 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f78ac005210 0x7f78c0161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 --2- 172.21.15.106:0/3758080796 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f78c01f3ae0 0x7f78c01f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 >> 172.21.15.106:0/3758080796 conn(0x7f78c00cd570 msgr2=0x7f78c00b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 shutdown_connections 2023-11-24T06:15:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.213+0000 7f78c5f17700 1 -- 172.21.15.106:0/3758080796 wait complete. 2023-11-24T06:15:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:15:04.228 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-11-24T06:15:03.704540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220612,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754108,"statfs":{"total":773094113280,"available":772868206592,"internally_reserved":0,"allocated":4530176,"data_stored":2494664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4199,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001270"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:14:57.221254+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:57.221254+0000","last_peered":"2023-11-24T06:14:57.221254+0000","last_clean":"2023-11-24T06:14:57.221254+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:57.221254+0000","last_undegraded":"2023-11-24T06:14:57.221254+0000","last_fullsized":"2023-11-24T06:14:57.221254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.57299999999999995},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.35899999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.63700000000000001}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69599999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66700000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.437}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.309},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.32400000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.372}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.315}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.33200000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.52500000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.497},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.54400000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.60199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.39500000000000002},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.433}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.502},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.45200000000000001}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.70299999999999996}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.71599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.33900000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.25700000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.441},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.80000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.59499999999999997}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.76300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.316},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.27700000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39200000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.98999999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.95399999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":1.016},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.42899999999999999}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.621},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59299999999999997}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64200000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.76100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.51100000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.54900000000000004}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.496}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47399999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.439},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.60699999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.59099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:04.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-24T06:15:04.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.347+0000 7f8c6bb41700 1 Processor -- start 2023-11-24T06:15:04.350 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 -- start start 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c6406c710 0x7f8c640b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c640af4d0 0x7f8c640afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c640ae430 con 0x7f8c6415e080 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c640af0b0 con 0x7f8c640af4d0 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.348+0000 7f8c6bb41700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c640b05a0 con 0x7f8c6406c710 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c640af4d0 0x7f8c640afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.353 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8c640af4d0 0x7f8c640afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60450/0 (socket says 172.21.15.106:60450) 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c698dd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8c6415e080 0x7f8c6406c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40708/0 (socket says 172.21.15.106:40708) 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 -- 172.21.15.106:0/3976095949 learned_addr learned my addr 172.21.15.106:0/3976095949 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c690dc700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c6406c710 0x7f8c640b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 -- 172.21.15.106:0/3976095949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c6406c710 msgr2=0x7f8c640b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c6406c710 0x7f8c640b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 -- 172.21.15.106:0/3976095949 >> v1:172.21.15.106:6789/0 conn(0x7f8c6415e080 legacy=0x7f8c6406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 -- 172.21.15.106:0/3976095949 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c640ae710 con 0x7f8c640af4d0 2023-11-24T06:15:04.354 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c688db700 1 -- 172.21.15.106:0/3976095949 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1214634233 0 0) 0x7f8c640ae430 con 0x7f8c6415e080 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c6a0de700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c640af4d0 0x7f8c640afb90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e80 tx=0x7f8c5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dccd7b78f9afa6a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c688db700 1 -- 172.21.15.106:0/3976095949 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00e070 con 0x7f8c640af4d0 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c688db700 1 -- 172.21.15.106:0/3976095949 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c00b980 con 0x7f8c640af4d0 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.349+0000 7f8c688db700 1 -- 172.21.15.106:0/3976095949 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00bd30 con 0x7f8c640af4d0 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 -- 172.21.15.106:0/3976095949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c640af4d0 msgr2=0x7f8c640afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c640af4d0 0x7f8c640afb90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c009e80 tx=0x7f8c5c00b330 comp rx=0 tx=0).stop 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 -- 172.21.15.106:0/3976095949 shutdown_connections 2023-11-24T06:15:04.355 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c640af4d0 0x7f8c640afb90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/3976095949 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c6406c710 0x7f8c640b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 -- 172.21.15.106:0/3976095949 >> 172.21.15.106:0/3976095949 conn(0x7f8c64071b90 msgr2=0x7f8c64071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 -- 172.21.15.106:0/3976095949 shutdown_connections 2023-11-24T06:15:04.356 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.350+0000 7f8c6bb41700 1 -- 172.21.15.106:0/3976095949 wait complete. 2023-11-24T06:15:04.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.351+0000 7f8c6bb41700 1 Processor -- start 2023-11-24T06:15:04.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.351+0000 7f8c6bb41700 1 -- start start 2023-11-24T06:15:04.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 0x7f8c640cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 0x7f8c641604c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415f4b0 con 0x7f8c6415e080 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415f700 con 0x7f8c6406c710 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6415f9e0 con 0x7f8c640af4d0 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60456/0 (socket says 172.21.15.106:60456) 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 -- 172.21.15.106:0/2863184434 learned_addr learned my addr 172.21.15.106:0/2863184434 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:04.360 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c690dc700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 0x7f8c641604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c698dd700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 0x7f8c640cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 -- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 msgr2=0x7f8c641604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 0x7f8c641604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 -- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 msgr2=0x7f8c640cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 0x7f8c640cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 -- 172.21.15.106:0/2863184434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009b30 con 0x7f8c6415e080 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c698dd700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 0x7f8c640cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:04.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c690dc700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 0x7f8c641604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6a0de700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b730 tx=0x7f8c5c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0099b0 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c0092e0 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c01c640 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.352+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6415fcc0 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.353+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6414bec0 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.353+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c640753f0 con 0x7f8c6415e080 2023-11-24T06:15:04.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.354+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c5c01c7a0 con 0x7f8c6415e080 2023-11-24T06:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.354+0000 7f8c5a7fc700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 0x7f8c4806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.354+0000 7f8c698dd700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 0x7f8c4806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.354+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8c5c08abb0 con 0x7f8c6415e080 2023-11-24T06:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.355+0000 7f8c698dd700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 0x7f8c4806d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f60 tx=0x7f8c54007d30 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:04.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.359+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c5c055ff0 con 0x7f8c6415e080 2023-11-24T06:15:04.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.552+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c64160180 con 0x7f8c6415e080 2023-11-24T06:15:04.555 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.553+0000 7f8c5a7fc700 1 -- 172.21.15.106:0/2863184434 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13012 (secure 0 0 0) 0x7f8c5c059610 con 0x7f8c6415e080 2023-11-24T06:15:04.556 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:04.556 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":36,"fsid":"2a42eb6f-5aad-4f8e-8067-d72b439cd81f","created":"2023-11-24T06:13:16.100993+0000","modified":"2023-11-24T06:14:57.496847+0000","last_up_change":"2023-11-24T06:13:27.668743+0000","last_in_change":"2023-11-24T06:13:18.603585+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-24T06:13:27.728296+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0da045f6-d4b5-4922-b1fc-776933661743","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6809","nonce":4260210820}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6811","nonce":4260210820}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6815","nonce":4260210820}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":4260210820},{"type":"v1","addr":"172.21.15.106:6813","nonce":4260210820}]},"public_addr":"172.21.15.106:6809/4260210820","cluster_addr":"172.21.15.106:6811/4260210820","heartbeat_back_addr":"172.21.15.106:6815/4260210820","heartbeat_front_addr":"172.21.15.106:6813/4260210820","state":["exists","up"]},{"osd":1,"uuid":"7cc5fa44-1fe2-408e-ab8f-c2a4c515b028","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6825","nonce":2882150614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6827","nonce":2882150614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6831","nonce":2882150614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":2882150614},{"type":"v1","addr":"172.21.15.106:6829","nonce":2882150614}]},"public_addr":"172.21.15.106:6825/2882150614","cluster_addr":"172.21.15.106:6827/2882150614","heartbeat_back_addr":"172.21.15.106:6831/2882150614","heartbeat_front_addr":"172.21.15.106:6829/2882150614","state":["exists","up"]},{"osd":2,"uuid":"5a59b21c-afed-4eff-afeb-184886fbb6fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6817","nonce":2683231264}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6819","nonce":2683231264}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6823","nonce":2683231264}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":2683231264},{"type":"v1","addr":"172.21.15.106:6821","nonce":2683231264}]},"public_addr":"172.21.15.106:6817/2683231264","cluster_addr":"172.21.15.106:6819/2683231264","heartbeat_back_addr":"172.21.15.106:6823/2683231264","heartbeat_front_addr":"172.21.15.106:6821/2683231264","state":["exists","up"]},{"osd":3,"uuid":"c9ed1c1e-6fcd-49e1-b7a2-7228ba2b2ce5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6801","nonce":85322157}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6803","nonce":85322157}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6807","nonce":85322157}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":85322157},{"type":"v1","addr":"172.21.15.106:6805","nonce":85322157}]},"public_addr":"172.21.15.106:6801/85322157","cluster_addr":"172.21.15.106:6803/85322157","heartbeat_back_addr":"172.21.15.106:6807/85322157","heartbeat_front_addr":"172.21.15.106:6805/85322157","state":["exists","up"]},{"osd":4,"uuid":"a6a59e69-2e4a-4a77-888e-604f5a5c36a7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6824","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6825","nonce":883773591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6826","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6827","nonce":883773591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6830","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6831","nonce":883773591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6828","nonce":883773591},{"type":"v1","addr":"172.21.15.176:6829","nonce":883773591}]},"public_addr":"172.21.15.176:6825/883773591","cluster_addr":"172.21.15.176:6827/883773591","heartbeat_back_addr":"172.21.15.176:6831/883773591","heartbeat_front_addr":"172.21.15.176:6829/883773591","state":["exists","up"]},{"osd":5,"uuid":"965eda1a-dfe2-4e4d-bcf5-e3c0ba2d70f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6816","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6817","nonce":3891434680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6818","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6819","nonce":3891434680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6822","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6823","nonce":3891434680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6820","nonce":3891434680},{"type":"v1","addr":"172.21.15.176:6821","nonce":3891434680}]},"public_addr":"172.21.15.176:6817/3891434680","cluster_addr":"172.21.15.176:6819/3891434680","heartbeat_back_addr":"172.21.15.176:6823/3891434680","heartbeat_front_addr":"172.21.15.176:6821/3891434680","state":["exists","up"]},{"osd":6,"uuid":"bfe565e7-4df0-4f6e-b55f-a0e0568649f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6808","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6809","nonce":4287270642}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6810","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6811","nonce":4287270642}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6814","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6815","nonce":4287270642}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6812","nonce":4287270642},{"type":"v1","addr":"172.21.15.176:6813","nonce":4287270642}]},"public_addr":"172.21.15.176:6809/4287270642","cluster_addr":"172.21.15.176:6811/4287270642","heartbeat_back_addr":"172.21.15.176:6815/4287270642","heartbeat_front_addr":"172.21.15.176:6813/4287270642","state":["exists","up"]},{"osd":7,"uuid":"8976da24-a35e-4a27-a78a-4927f329f787","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6800","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6801","nonce":1585070888}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6802","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6803","nonce":1585070888}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6806","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6807","nonce":1585070888}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6804","nonce":1585070888},{"type":"v1","addr":"172.21.15.176:6805","nonce":1585070888}]},"public_addr":"172.21.15.176:6801/1585070888","cluster_addr":"172.21.15.176:6803/1585070888","heartbeat_back_addr":"172.21.15.176:6807/1585070888","heartbeat_front_addr":"172.21.15.176:6805/1585070888","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.767768+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.783638+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.860804+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.775793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.773224+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815041+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.815593+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-24T06:13:23.780631+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.176:6835/2432507264":"2023-11-25T06:14:54.488554+0000","172.21.15.176:6833/2432507264":"2023-11-25T06:14:54.488554+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-24T06:15:04.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 msgr2=0x7f8c4806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 0x7f8c4806d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8c54000f60 tx=0x7f8c54007d30 comp rx=0 tx=0).stop 2023-11-24T06:15:04.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 msgr2=0x7f8c64160a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:04.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00b730 tx=0x7f8c5c004ad0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 shutdown_connections 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f8c4806aed0 0x7f8c4806d390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c6415e080 0x7f8c64160a00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f8c6406c710 0x7f8c640cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 --2- 172.21.15.106:0/2863184434 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f8c640af4d0 0x7f8c641604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 >> 172.21.15.106:0/2863184434 conn(0x7f8c64071b90 msgr2=0x7f8c6406aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 shutdown_connections 2023-11-24T06:15:04.559 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:04.555+0000 7f8c6bb41700 1 -- 172.21.15.106:0/2863184434 wait complete. 2023-11-24T06:15:05.570 INFO:tasks.ceph:Scrubbing osd.0 2023-11-24T06:15:05.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.709+0000 7fa331a51700 1 Processor -- start 2023-11-24T06:15:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.709+0000 7fa331a51700 1 -- start start 2023-11-24T06:15:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa331a51700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa32c15e0b0 0x7fa32c06c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa331a51700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fa32c0afb60 0x7fa32c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa331a51700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa32c1624c0 con 0x7fa32c0b5b60 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa331a51700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c15e490 con 0x7fa32c15e0b0 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa331a51700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32c06ebc0 con 0x7fa32c0afb60 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa32c15e0b0 0x7fa32c06c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa32c15e0b0 0x7fa32c06c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60460/0 (socket says 172.21.15.106:60460) 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 -- 172.21.15.106:0/2099223292 learned_addr learned my addr 172.21.15.106:0/2099223292 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32b7fe700 1 --2- 172.21.15.106:0/2099223292 >> v2:172.21.15.176:3300/0 conn(0x7fa32c0afb60 0x7fa32c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 -- 172.21.15.106:0/2099223292 >> v2:172.21.15.176:3300/0 conn(0x7fa32c0afb60 msgr2=0x7fa32c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 --2- 172.21.15.106:0/2099223292 >> v2:172.21.15.176:3300/0 conn(0x7fa32c0afb60 0x7fa32c06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 -- 172.21.15.106:0/2099223292 >> v1:172.21.15.176:6789/0 conn(0x7fa32c0b5b60 legacy=0x7fa32c073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.710+0000 7fa32affd700 1 -- 172.21.15.106:0/2099223292 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c161b90 con 0x7fa32c15e0b0 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa32affd700 1 --2- 172.21.15.106:0/2099223292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c15e0b0 0x7fa32c06c000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa32c162430 tx=0x7fa320009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5497a0b40b11ed66 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa329ffb700 1 -- 172.21.15.106:0/2099223292 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa320004230 con 0x7fa32c15e0b0 2023-11-24T06:15:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa329ffb700 1 -- 172.21.15.106:0/2099223292 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa320004390 con 0x7fa32c15e0b0 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa329ffb700 1 -- 172.21.15.106:0/2099223292 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200036a0 con 0x7fa32c15e0b0 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 -- 172.21.15.106:0/2099223292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c15e0b0 msgr2=0x7fa32c06c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 --2- 172.21.15.106:0/2099223292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c15e0b0 0x7fa32c06c000 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa32c162430 tx=0x7fa320009bd0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 -- 172.21.15.106:0/2099223292 shutdown_connections 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 --2- 172.21.15.106:0/2099223292 >> v2:172.21.15.176:3300/0 conn(0x7fa32c0afb60 0x7fa32c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 --2- 172.21.15.106:0/2099223292 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c15e0b0 0x7fa32c06c000 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 -- 172.21.15.106:0/2099223292 >> 172.21.15.106:0/2099223292 conn(0x7fa32c071b50 msgr2=0x7fa32c071f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 -- 172.21.15.106:0/2099223292 shutdown_connections 2023-11-24T06:15:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.711+0000 7fa331a51700 1 -- 172.21.15.106:0/2099223292 wait complete. 2023-11-24T06:15:05.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.713+0000 7fa331a51700 1 Processor -- start 2023-11-24T06:15:05.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.713+0000 7fa331a51700 1 -- start start 2023-11-24T06:15:05.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.713+0000 7fa331a51700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa32c0afb60 0x7fa32c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.713+0000 7fa331a51700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 0x7fa32c15ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa32c15e0b0 0x7fa32c14e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c15e5d0 con 0x7fa32c0b5b60 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c15ee70 con 0x7fa32c15e0b0 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32c1f7db0 con 0x7fa32c0afb60 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 0x7fa32c15ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 0x7fa32c15ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60468/0 (socket says 172.21.15.106:60468) 2023-11-24T06:15:05.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 -- 172.21.15.106:0/1238880074 learned_addr learned my addr 172.21.15.106:0/1238880074 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32affd700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa32c0afb60 0x7fa32c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32b7fe700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa32c15e0b0 0x7fa32c14e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 -- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa32c0afb60 msgr2=0x7fa32c15f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa32c0afb60 0x7fa32c15f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 -- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa32c15e0b0 msgr2=0x7fa32c14e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa32c15e0b0 0x7fa32c14e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009550 con 0x7fa32c0b5b60 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32affd700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa32c0afb60 0x7fa32c15f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32b7fe700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa32c15e0b0 0x7fa32c14e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa32a7fc700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 0x7fa32c15ad00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c4a0 tx=0x7fa31c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c0054e0 con 0x7fa32c0b5b60 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31c003680 con 0x7fa32c0b5b60 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa32c15e820 con 0x7fa32c0b5b60 2023-11-24T06:15:05.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31c003a10 con 0x7fa32c0b5b60 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.714+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa32c15b240 con 0x7fa32c0b5b60 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.715+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa32c0b6040 con 0x7fa32c0b5b60 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa31c003b70 con 0x7fa32c0b5b60 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa31806af00 0x7fa31806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa31c089160 con 0x7fa32c0b5b60 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa32affd700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa31806af00 0x7fa31806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7fa318070d60 0x7fa318073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.725 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa318073850 con 0x7fa318070d60 2023-11-24T06:15:05.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.716+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa31c0894d0 con 0x7fa32c0b5b60 2023-11-24T06:15:05.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.717+0000 7fa32b7fe700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7fa318070d60 0x7fa318073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.717+0000 7fa32affd700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa31806af00 0x7fa31806d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa320009c10 tx=0x7fa320008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.717+0000 7fa32b7fe700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7fa318070d60 0x7fa318073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.726 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.717+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== osd.0 v2:172.21.15.106:6808/4260210820 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa318073850 con 0x7fa318070d60 2023-11-24T06:15:05.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.732+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 --> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa32c162150 con 0x7fa318070d60 2023-11-24T06:15:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa313fff700 1 -- 172.21.15.106:0/1238880074 <== osd.0 v2:172.21.15.106:6808/4260210820 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa32400e3f0 con 0x7fa318070d60 2023-11-24T06:15:05.736 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:05.736 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:05.736 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7fa318070d60 msgr2=0x7fa318073180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6808/4260210820,v1:172.21.15.106:6809/4260210820] conn(0x7fa318070d60 0x7fa318073180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa31806af00 msgr2=0x7fa31806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa31806af00 0x7fa31806d3c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa320009c10 tx=0x7fa320008030 comp rx=0 tx=0).stop 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 msgr2=0x7fa32c15ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 --2- 172.21.15.106:0/1238880074 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa32c0b5b60 0x7fa32c15ad00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa31c00c4a0 tx=0x7fa31c00c860 comp rx=0 tx=0).stop 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa32b7fe700 1 -- 172.21.15.106:0/1238880074 reap_dead start 2023-11-24T06:15:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 shutdown_connections 2023-11-24T06:15:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 >> 172.21.15.106:0/1238880074 conn(0x7fa32c071b50 msgr2=0x7fa32c06aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 shutdown_connections 2023-11-24T06:15:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.733+0000 7fa331a51700 1 -- 172.21.15.106:0/1238880074 wait complete. 2023-11-24T06:15:05.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-11-24T06:15:05.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.867+0000 7f74acf7c700 1 Processor -- start 2023-11-24T06:15:05.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.867+0000 7f74acf7c700 1 -- start start 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74acf7c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80b3370 0x7f74a81604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74acf7c700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a80d1c70 0x7f74a80d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74acf7c700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a80b22d0 con 0x7f74a815bdd0 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74acf7c700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a80b2f50 con 0x7f74a80d1c70 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74acf7c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a80d2640 con 0x7f74a80b3370 2023-11-24T06:15:05.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a80d1c70 0x7f74a80d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f74a80d1c70 0x7f74a80d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60480/0 (socket says 172.21.15.106:60480) 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 -- 172.21.15.106:0/3353246125 learned_addr learned my addr 172.21.15.106:0/3353246125 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a5d9b700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80b3370 0x7f74a81604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 -- 172.21.15.106:0/3353246125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80b3370 msgr2=0x7f74a81604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80b3370 0x7f74a81604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 -- 172.21.15.106:0/3353246125 >> v1:172.21.15.176:6789/0 conn(0x7f74a815bdd0 legacy=0x7f74a80b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 -- 172.21.15.106:0/3353246125 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a80b25b0 con 0x7f74a80d1c70 2023-11-24T06:15:05.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a6d9d700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80d1c70 0x7f74a80d2100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e50 tx=0x7f74a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e0ba1f66354c58 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a559a700 1 -- 172.21.15.106:0/3353246125 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a000e070 con 0x7f74a80d1c70 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a559a700 1 -- 172.21.15.106:0/3353246125 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a0003a20 con 0x7f74a80d1c70 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.868+0000 7f74a559a700 1 -- 172.21.15.106:0/3353246125 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0003dd0 con 0x7f74a80d1c70 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 -- 172.21.15.106:0/3353246125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80d1c70 msgr2=0x7f74a80d2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80d1c70 0x7f74a80d2100 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009e50 tx=0x7f74a000b330 comp rx=0 tx=0).stop 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 -- 172.21.15.106:0/3353246125 shutdown_connections 2023-11-24T06:15:05.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80d1c70 0x7f74a80d2100 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 --2- 172.21.15.106:0/3353246125 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80b3370 0x7f74a81604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 -- 172.21.15.106:0/3353246125 >> 172.21.15.106:0/3353246125 conn(0x7f74a80731a0 msgr2=0x7f74a809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:05.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 -- 172.21.15.106:0/3353246125 shutdown_connections 2023-11-24T06:15:05.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.869+0000 7f74acf7c700 1 -- 172.21.15.106:0/3353246125 wait complete. 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.870+0000 7f74acf7c700 1 Processor -- start 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.870+0000 7f74acf7c700 1 -- start start 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80d1c70 0x7f74a80ced20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 0x7f74a80cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815f150 con 0x7f74a80b3370 2023-11-24T06:15:05.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815e8b0 con 0x7f74a815bdd0 2023-11-24T06:15:05.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74acf7c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a815eb90 con 0x7f74a80d1c70 2023-11-24T06:15:05.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60484/0 (socket says 172.21.15.106:60484) 2023-11-24T06:15:05.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a659c700 1 -- 172.21.15.106:0/838881010 learned_addr learned my addr 172.21.15.106:0/838881010 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:05.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a6d9d700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 0x7f74a80cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a5d9b700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80d1c70 0x7f74a80ced20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.880 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a659c700 1 -- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80d1c70 msgr2=0x7f74a80ced20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.871+0000 7f74a659c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80d1c70 0x7f74a80ced20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74a659c700 1 -- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 msgr2=0x7f74a80cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74a659c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 0x7f74a80cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74a659c700 1 -- 172.21.15.106:0/838881010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a0009b30 con 0x7f74a80b3370 2023-11-24T06:15:05.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74a6d9d700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 0x7f74a80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74a659c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f749800b4a0 tx=0x7f749800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011830 con 0x7f74a80b3370 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7498011990 con 0x7f74a80b3370 2023-11-24T06:15:05.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74a815ee70 con 0x7f74a80b3370 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7498011d40 con 0x7f74a80b3370 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.872+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a8156900 con 0x7f74a80b3370 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.873+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a80ccc60 con 0x7f74a80b3370 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.873+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f749801a400 con 0x7f74a80b3370 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.874+0000 7f7496ffd700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 0x7f748806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:05.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.874+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7498089020 con 0x7f74a80b3370 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.874+0000 7f74a5d9b700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 0x7f748806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.874+0000 7f74a5d9b700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 0x7f748806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74a80b7b30 tx=0x7f749c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:05.878+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74980543d0 con 0x7f74a80b3370 2023-11-24T06:15:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.072+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f74a80b2b70 con 0x7f748806aed0 2023-11-24T06:15:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.072+0000 7f7496ffd700 1 -- 172.21.15.106:0/838881010 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f749c00c040 con 0x7f748806aed0 2023-11-24T06:15:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 msgr2=0x7f748806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 0x7f748806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f74a80b7b30 tx=0x7f749c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 msgr2=0x7f74a815dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f749800b4a0 tx=0x7f749800b860 comp rx=0 tx=0).stop 2023-11-24T06:15:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 shutdown_connections 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f748806aed0 0x7f748806d390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f74a815bdd0 0x7f74a80cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74a80b3370 0x7f74a815dee0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 --2- 172.21.15.106:0/838881010 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f74a80d1c70 0x7f74a80ced20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 >> 172.21.15.106:0/838881010 conn(0x7f74a80731a0 msgr2=0x7f74a806cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 shutdown_connections 2023-11-24T06:15:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.074+0000 7f74acf7c700 1 -- 172.21.15.106:0/838881010 wait complete. 2023-11-24T06:15:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2023-11-24T06:15:06.088 INFO:tasks.ceph:Scrubbing osd.1 2023-11-24T06:15:06.089 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.210+0000 7f7304f3d700 1 Processor -- start 2023-11-24T06:15:06.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.210+0000 7f7304f3d700 1 -- start start 2023-11-24T06:15:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f7304f3d700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f73001586c0 0x7f7300071990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f7304f3d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730015c2e0 con 0x7f730006eb70 2023-11-24T06:15:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f7304f3d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000b2be0 con 0x7f7300071ed0 2023-11-24T06:15:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f7304f3d700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7300072430 con 0x7f73001586c0 2023-11-24T06:15:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f72fed9d700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f730006eb70 0x7f73000b3960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40754/0 (socket says 172.21.15.106:40754) 2023-11-24T06:15:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f72fed9d700 1 -- 172.21.15.106:0/1364116663 learned_addr learned my addr 172.21.15.106:0/1364116663 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.211+0000 7f72fe59c700 1 --2- 172.21.15.106:0/1364116663 >> v2:172.21.15.176:3300/0 conn(0x7f73001586c0 0x7f7300071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743227579 0 0) 0x7f730015c2e0 con 0x7f730006eb70 2023-11-24T06:15:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e80035b0 con 0x7f730006eb70 2023-11-24T06:15:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 719205260 0 0) 0x7f72e80035b0 con 0x7f730006eb70 2023-11-24T06:15:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 >> v2:172.21.15.176:3300/0 conn(0x7f73001586c0 msgr2=0x7f7300071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 --2- 172.21.15.106:0/1364116663 >> v2:172.21.15.176:3300/0 conn(0x7f73001586c0 0x7f7300071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 >> v1:172.21.15.176:6789/0 conn(0x7f7300071ed0 legacy=0x7f730006e460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:06.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000b2e80 con 0x7f730006eb70 2023-11-24T06:15:06.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f72f80019f0 con 0x7f730006eb70 2023-11-24T06:15:06.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 >> v1:172.21.15.106:6789/0 conn(0x7f730006eb70 legacy=0x7f73000b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 0x7f72e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.221 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8004850 0x7f72e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72e8005210 0x7f72e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300072430 con 0x7f72e8003a00 2023-11-24T06:15:06.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800c140 con 0x7f72e8004850 2023-11-24T06:15:06.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800c300 con 0x7f72e8005210 2023-11-24T06:15:06.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 0x7f72e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fdd9b700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8004850 0x7f72e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 -- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72e8005210 msgr2=0x7f72e800ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-11-24T06:15:06.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f72e8005210 0x7f72e800ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 -- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8004850 msgr2=0x7f72e8004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8004850 0x7f72e8004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 -- 172.21.15.106:0/1364116663 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e80035b0 con 0x7f72e8003a00 2023-11-24T06:15:06.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fed9d700 1 -- 172.21.15.106:0/1364116663 reap_dead start 2023-11-24T06:15:06.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.212+0000 7f72fe59c700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 0x7f72e8003e00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009b60 tx=0x7f72e8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a1beddf36dcd6b server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400e6c0 con 0x7f72e8003a00 2023-11-24T06:15:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400e820 con 0x7f72e8003a00 2023-11-24T06:15:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f72fd59a700 1 -- 172.21.15.106:0/1364116663 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400ebb0 con 0x7f72e8003a00 2023-11-24T06:15:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 -- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 msgr2=0x7f72e8003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 0x7f72e8003e00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f72f4009b60 tx=0x7f72e8005880 comp rx=0 tx=0).stop 2023-11-24T06:15:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 -- 172.21.15.106:0/1364116663 shutdown_connections 2023-11-24T06:15:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 --2- 172.21.15.106:0/1364116663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72e8003a00 0x7f72e8003e00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 -- 172.21.15.106:0/1364116663 >> 172.21.15.106:0/1364116663 conn(0x7f73000b1740 msgr2=0x7f73000b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 -- 172.21.15.106:0/1364116663 shutdown_connections 2023-11-24T06:15:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.213+0000 7f7304f3d700 1 -- 172.21.15.106:0/1364116663 wait complete. 2023-11-24T06:15:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 Processor -- start 2023-11-24T06:15:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 -- start start 2023-11-24T06:15:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8003a00 0x7f730014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 0x7f730013f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f730015b570 0x7f7300158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73001580e0 con 0x7f7300157c80 2023-11-24T06:15:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7300156be0 con 0x7f72e8003a00 2023-11-24T06:15:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f7304f3d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7300156ec0 con 0x7f730015b570 2023-11-24T06:15:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f72fdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 0x7f730013f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f72fdd9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 0x7f730013f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60504/0 (socket says 172.21.15.106:60504) 2023-11-24T06:15:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.215+0000 7f72fdd9b700 1 -- 172.21.15.106:0/3988479864 learned_addr learned my addr 172.21.15.106:0/3988479864 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 -- 172.21.15.106:0/3988479864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f730015b570 msgr2=0x7f7300158fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f730015b570 0x7f7300158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 -- 172.21.15.106:0/3988479864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8003a00 msgr2=0x7f730014fe00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-24T06:15:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f72e8003a00 0x7f730014fe00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73001571a0 con 0x7f7300157c80 2023-11-24T06:15:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72fdd9b700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 0x7f730013f870 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f72f000e770 tx=0x7f72f000eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0013680 con 0x7f7300157c80 2023-11-24T06:15:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0013800 con 0x7f7300157c80 2023-11-24T06:15:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0013bb0 con 0x7f7300157c80 2023-11-24T06:15:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7300157480 con 0x7f7300157c80 2023-11-24T06:15:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.216+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730015ba00 con 0x7f7300157c80 2023-11-24T06:15:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.217+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7300157030 con 0x7f7300157c80 2023-11-24T06:15:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.217+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72f0013d10 con 0x7f7300157c80 2023-11-24T06:15:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72eeffd700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f72e006aed0 0x7f72e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72f0089a30 con 0x7f7300157c80 2023-11-24T06:15:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72fe59c700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f72e006aed0 0x7f72e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72eeffd700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f72e0070d30 0x7f72e0073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72e0073820 con 0x7f72e0070d30 2023-11-24T06:15:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72f0089de0 con 0x7f7300157c80 2023-11-24T06:15:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72fed9d700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f72e0070d30 0x7f72e0073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72fe59c700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f72e006aed0 0x7f72e006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7300158f50 tx=0x7f72f4008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.218+0000 7f72fed9d700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f72e0070d30 0x7f72e0073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.219+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== osd.1 v2:172.21.15.106:6824/2882150614 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f72e0073820 con 0x7f72e0070d30 2023-11-24T06:15:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.234+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 --> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f73000b46a0 con 0x7f72e0070d30 2023-11-24T06:15:06.240 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.234+0000 7f72eeffd700 1 -- 172.21.15.106:0/3988479864 <== osd.1 v2:172.21.15.106:6824/2882150614 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f73000b46a0 con 0x7f72e0070d30 2023-11-24T06:15:06.240 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:06.240 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:06.241 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.234+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f72e0070d30 msgr2=0x7f72e0073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.234+0000 7f7304f3d700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6824/2882150614,v1:172.21.15.106:6825/2882150614] conn(0x7f72e0070d30 0x7f72e0073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f72e006aed0 msgr2=0x7f72e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f72e006aed0 0x7f72e006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7300158f50 tx=0x7f72f4008030 comp rx=0 tx=0).stop 2023-11-24T06:15:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 msgr2=0x7f730013f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 --2- 172.21.15.106:0/3988479864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7300157c80 0x7f730013f870 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f72f000e770 tx=0x7f72f000eb30 comp rx=0 tx=0).stop 2023-11-24T06:15:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f72fed9d700 1 -- 172.21.15.106:0/3988479864 reap_dead start 2023-11-24T06:15:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 shutdown_connections 2023-11-24T06:15:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 >> 172.21.15.106:0/3988479864 conn(0x7f73000b1740 msgr2=0x7f73000ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 shutdown_connections 2023-11-24T06:15:06.245 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.235+0000 7f7304f3d700 1 -- 172.21.15.106:0/3988479864 wait complete. 2023-11-24T06:15:06.249 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-11-24T06:15:06.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.368+0000 7fa849e7d700 1 Processor -- start 2023-11-24T06:15:06.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.368+0000 7fa849e7d700 1 -- start start 2023-11-24T06:15:06.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa849e7d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa844152cc0 0x7fa84406c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa849e7d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84415c4b0 con 0x7fa8440d0630 2023-11-24T06:15:06.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa849e7d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa84415c790 con 0x7fa8440b49a0 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa849e7d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415ca70 con 0x7fa844152cc0 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa843fff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8440d0630 0x7fa84415fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40778/0 (socket says 172.21.15.106:40778) 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa843fff700 1 -- 172.21.15.106:0/3731712683 learned_addr learned my addr 172.21.15.106:0/3731712683 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8437fe700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa844152cc0 0x7fa84406c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1119127876 0 0) 0x7fa84415c4b0 con 0x7fa8440d0630 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8300035b0 con 0x7fa8440d0630 2023-11-24T06:15:06.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1486650146 0 0) 0x7fa8300035b0 con 0x7fa8440d0630 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa844152cc0 msgr2=0x7fa84406c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa844152cc0 0x7fa84406c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 >> v1:172.21.15.176:6789/0 conn(0x7fa8440b49a0 legacy=0x7fa8440cff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84415cd50 con 0x7fa8440d0630 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fa83c0019f0 con 0x7fa8440d0630 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.369+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 >> v1:172.21.15.106:6789/0 conn(0x7fa8440d0630 legacy=0x7fa84415fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830003a30 0x7fa830003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa830004850 0x7fa830004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa830005210 0x7fa83000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84415ca70 con 0x7fa830005210 2023-11-24T06:15:06.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83000c0e0 con 0x7fa830003a30 2023-11-24T06:15:06.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa83000c2a0 con 0x7fa830004850 2023-11-24T06:15:06.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8437fe700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa844152cc0 0x7fa84406c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa830005210 0x7fa83000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa842ffd700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa830004850 0x7fa830004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8437fe700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830003a30 0x7fa830003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 -- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa830004850 msgr2=0x7fa830004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa830004850 0x7fa830004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 -- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830003a30 msgr2=0x7fa830003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830003a30 0x7fa830003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 -- 172.21.15.106:0/3731712683 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300035b0 con 0x7fa830005210 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa842ffd700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa830004850 0x7fa830004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa843fff700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa830005210 0x7fa83000ba10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00a830 tx=0x7fa830005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc951ace8fd51f97 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012600 con 0x7fa830005210 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c0127a0 con 0x7fa830005210 2023-11-24T06:15:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.370+0000 7fa8427fc700 1 -- 172.21.15.106:0/3731712683 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c012b50 con 0x7fa830005210 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 -- 172.21.15.106:0/3731712683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa830005210 msgr2=0x7fa83000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 --2- 172.21.15.106:0/3731712683 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa830005210 0x7fa83000ba10 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00a830 tx=0x7fa830005880 comp rx=0 tx=0).stop 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa843fff700 1 -- 172.21.15.106:0/3731712683 reap_dead start 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 -- 172.21.15.106:0/3731712683 shutdown_connections 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 -- 172.21.15.106:0/3731712683 >> 172.21.15.106:0/3731712683 conn(0x7fa844071b90 msgr2=0x7fa844071fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 -- 172.21.15.106:0/3731712683 shutdown_connections 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.371+0000 7fa849e7d700 1 -- 172.21.15.106:0/3731712683 wait complete. 2023-11-24T06:15:06.383 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.372+0000 7fa849e7d700 1 Processor -- start 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.372+0000 7fa849e7d700 1 -- start start 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830005210 0x7fa844147330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8440b1ca0 0x7fa8440b2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440b2660 con 0x7fa84415ebc0 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84406dad0 con 0x7fa830005210 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa849e7d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84406dd70 con 0x7fa8440b1ca0 2023-11-24T06:15:06.384 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60528/0 (socket says 172.21.15.106:60528) 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 -- 172.21.15.106:0/2480527458 learned_addr learned my addr 172.21.15.106:0/2480527458 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa8437fe700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830005210 0x7fa844147330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa842ffd700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8440b1ca0 0x7fa8440b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 -- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8440b1ca0 msgr2=0x7fa8440b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8440b1ca0 0x7fa8440b2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 -- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830005210 msgr2=0x7fa844147330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.385 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830005210 0x7fa844147330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.373+0000 7fa843fff700 1 -- 172.21.15.106:0/2480527458 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84406e050 con 0x7fa84415ebc0 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa843fff700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa83c002230 tx=0x7fa83c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c024030 con 0x7fa84415ebc0 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c012d40 con 0x7fa84415ebc0 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84406e330 con 0x7fa84415ebc0 2023-11-24T06:15:06.386 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c01e670 con 0x7fa84415ebc0 2023-11-24T06:15:06.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.374+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84415f5b0 con 0x7fa84415ebc0 2023-11-24T06:15:06.387 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.375+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8440753f0 con 0x7fa84415ebc0 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.375+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa83c027070 con 0x7fa84415ebc0 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.375+0000 7fa83bfff700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 0x7fa82406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.376+0000 7fa8437fe700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 0x7fa82406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.376+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa83c025070 con 0x7fa84415ebc0 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.376+0000 7fa8437fe700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 0x7fa82406d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa844075030 tx=0x7fa82c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.388 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.380+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa83c056580 con 0x7fa84415ebc0 2023-11-24T06:15:06.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.570+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa84406dee0 con 0x7fa82406aed0 2023-11-24T06:15:06.573 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.571+0000 7fa83bfff700 1 -- 172.21.15.106:0/2480527458 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa84406dee0 con 0x7fa82406aed0 2023-11-24T06:15:06.576 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 msgr2=0x7fa82406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 0x7fa82406d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa844075030 tx=0x7fa82c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 msgr2=0x7fa84415f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa83c002230 tx=0x7fa83c001d80 comp rx=0 tx=0).stop 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 shutdown_connections 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa82406aed0 0x7fa82406d390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.577 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa84415ebc0 0x7fa84415f070 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa830005210 0x7fa844147330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 --2- 172.21.15.106:0/2480527458 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8440b1ca0 0x7fa8440b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 >> 172.21.15.106:0/2480527458 conn(0x7fa844071b90 msgr2=0x7fa8440b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 shutdown_connections 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.573+0000 7fa849e7d700 1 -- 172.21.15.106:0/2480527458 wait complete. 2023-11-24T06:15:06.578 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2023-11-24T06:15:06.587 INFO:tasks.ceph:Scrubbing osd.2 2023-11-24T06:15:06.587 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.708+0000 7ff71d9ef700 1 Processor -- start 2023-11-24T06:15:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.708+0000 7ff71d9ef700 1 -- start start 2023-11-24T06:15:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.709+0000 7ff71d9ef700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff71815dfe0 0x7ff7180d3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.709+0000 7ff71d9ef700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7180b6040 0x7ff7180b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.709+0000 7ff71d9ef700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7180d1e60 con 0x7ff7180d39a0 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.709+0000 7ff71d9ef700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7180d2ae0 con 0x7ff7180b6040 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.709+0000 7ff71d9ef700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180d2140 con 0x7ff71815dfe0 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7180b6040 0x7ff7180b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7180b6040 0x7ff7180b6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60536/0 (socket says 172.21.15.106:60536) 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 -- 172.21.15.106:0/1543854510 learned_addr learned my addr 172.21.15.106:0/1543854510 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff716ffd700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff71815dfe0 0x7ff7180d3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 -- 172.21.15.106:0/1543854510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff71815dfe0 msgr2=0x7ff7180d3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff71815dfe0 0x7ff7180d3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 -- 172.21.15.106:0/1543854510 >> v1:172.21.15.176:6789/0 conn(0x7ff7180d39a0 legacy=0x7ff7180b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 -- 172.21.15.106:0/1543854510 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180d2420 con 0x7ff7180b6040 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff7177fe700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7180b6040 0x7ff7180b6f40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff710009e50 tx=0x7ff71000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f0520b0f75b030 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff715ffb700 1 -- 172.21.15.106:0/1543854510 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71000e070 con 0x7ff7180b6040 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff715ffb700 1 -- 172.21.15.106:0/1543854510 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71000b9c0 con 0x7ff7180b6040 2023-11-24T06:15:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.710+0000 7ff715ffb700 1 -- 172.21.15.106:0/1543854510 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71000bd70 con 0x7ff7180b6040 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1543854510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7180b6040 msgr2=0x7ff7180b6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7180b6040 0x7ff7180b6f40 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff710009e50 tx=0x7ff71000b330 comp rx=0 tx=0).stop 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1543854510 shutdown_connections 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff71815dfe0 0x7ff7180d3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1543854510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7180b6040 0x7ff7180b6f40 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1543854510 >> 172.21.15.106:0/1543854510 conn(0x7ff7180d0b10 msgr2=0x7ff7180d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1543854510 shutdown_connections 2023-11-24T06:15:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.711+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1543854510 wait complete. 2023-11-24T06:15:06.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.712+0000 7ff71d9ef700 1 Processor -- start 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.712+0000 7ff71d9ef700 1 -- start start 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7180b6040 0x7ff718152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7180d39a0 0x7ff718158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 0x7ff71815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7181588c0 con 0x7ff71815dfe0 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815a960 con 0x7ff7180d39a0 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.713+0000 7ff71d9ef700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7180b82d0 con 0x7ff7180b6040 2023-11-24T06:15:06.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 0x7ff71815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 0x7ff71815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60542/0 (socket says 172.21.15.106:60542) 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 -- 172.21.15.106:0/1969614493 learned_addr learned my addr 172.21.15.106:0/1969614493 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff716ffd700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7180b6040 0x7ff718152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7167fc700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7180d39a0 0x7ff718158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 -- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7180b6040 msgr2=0x7ff718152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff7180b6040 0x7ff718152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 -- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7180d39a0 msgr2=0x7ff718158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff7180d39a0 0x7ff718158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710009b30 con 0x7ff71815dfe0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff7177fe700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 0x7ff71815a420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff710012000 tx=0x7ff710004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710004800 con 0x7ff71815dfe0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710004960 con 0x7ff71815dfe0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff718158ad0 con 0x7ff71815dfe0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71001c680 con 0x7ff71815dfe0 2023-11-24T06:15:06.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.714+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180b8520 con 0x7ff71815dfe0 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.715+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff7180d2f00 con 0x7ff71815dfe0 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff71001c7e0 con 0x7ff71815dfe0 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff70406aed0 0x7ff70406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff71008ab40 con 0x7ff71815dfe0 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff716ffd700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff70406aed0 0x7ff70406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7ff704070d30 0x7ff704073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff704073820 con 0x7ff704070d30 2023-11-24T06:15:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff71008f240 con 0x7ff71815dfe0 2023-11-24T06:15:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff7167fc700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7ff704070d30 0x7ff704073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.716+0000 7ff716ffd700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff70406aed0 0x7ff70406d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007a30 tx=0x7ff70c008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.717+0000 7ff7167fc700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7ff704070d30 0x7ff704073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.724 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.717+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== osd.2 v2:172.21.15.106:6816/2683231264 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff704073820 con 0x7ff704070d30 2023-11-24T06:15:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.732+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 --> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff718158f90 con 0x7ff704070d30 2023-11-24T06:15:06.735 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.732+0000 7ff6fffff700 1 -- 172.21.15.106:0/1969614493 <== osd.2 v2:172.21.15.106:6816/2683231264 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff718158f90 con 0x7ff704070d30 2023-11-24T06:15:06.735 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:06.736 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:06.736 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7ff704070d30 msgr2=0x7ff704073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6816/2683231264,v1:172.21.15.106:6817/2683231264] conn(0x7ff704070d30 0x7ff704073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff70406aed0 msgr2=0x7ff70406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff70406aed0 0x7ff70406d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff70c007a30 tx=0x7ff70c008040 comp rx=0 tx=0).stop 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 msgr2=0x7ff71815a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 --2- 172.21.15.106:0/1969614493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71815dfe0 0x7ff71815a420 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff710012000 tx=0x7ff710004ad0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff7177fe700 1 -- 172.21.15.106:0/1969614493 reap_dead start 2023-11-24T06:15:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 shutdown_connections 2023-11-24T06:15:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 >> 172.21.15.106:0/1969614493 conn(0x7ff7180d0b10 msgr2=0x7ff7180b57b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 shutdown_connections 2023-11-24T06:15:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.733+0000 7ff71d9ef700 1 -- 172.21.15.106:0/1969614493 wait complete. 2023-11-24T06:15:06.747 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-11-24T06:15:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.866+0000 7fbf1ce05700 1 Processor -- start 2023-11-24T06:15:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.866+0000 7fbf1ce05700 1 -- start start 2023-11-24T06:15:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1ce05700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fbf1815bdd0 0x7fbf181604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1ce05700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180b22d0 con 0x7fbf180b3370 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1ce05700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf180b25b0 con 0x7fbf180d1c70 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1ce05700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf180b2f50 con 0x7fbf1815bdd0 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf15d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbf180b3370 0x7fbf180b1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40810/0 (socket says 172.21.15.106:40810) 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf15d9b700 1 -- 172.21.15.106:0/22765194 learned_addr learned my addr 172.21.15.106:0/22765194 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 392534415 0 0) 0x7fbf180b22d0 con 0x7fbf180b3370 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf000035b0 con 0x7fbf180b3370 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1659c700 1 --2- 172.21.15.106:0/22765194 >> v2:172.21.15.176:3300/0 conn(0x7fbf1815bdd0 0x7fbf181604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1018453249 0 0) 0x7fbf000035b0 con 0x7fbf180b3370 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 >> v2:172.21.15.176:3300/0 conn(0x7fbf1815bdd0 msgr2=0x7fbf181604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 --2- 172.21.15.106:0/22765194 >> v2:172.21.15.176:3300/0 conn(0x7fbf1815bdd0 0x7fbf181604e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 >> v1:172.21.15.176:6789/0 conn(0x7fbf180d1c70 legacy=0x7fbf18165ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180b2890 con 0x7fbf180b3370 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fbf08001670 con 0x7fbf180b3370 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1659c700 1 --2- 172.21.15.106:0/22765194 >> v2:172.21.15.176:3300/0 conn(0x7fbf1815bdd0 0x7fbf181604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 >> v1:172.21.15.106:6789/0 conn(0x7fbf180b3370 legacy=0x7fbf180b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf00003a00 0x7fbf00003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf00004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf00005210 0x7fbf0000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180b2f50 con 0x7fbf00004850 2023-11-24T06:15:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0000c160 con 0x7fbf00005210 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.867+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0000c320 con 0x7fbf00003a00 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf00004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf1659c700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf00003a00 0x7fbf00003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf16d9d700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf00005210 0x7fbf0000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 -- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf00003a00 msgr2=0x7fbf00003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf00003a00 0x7fbf00003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 -- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf00005210 msgr2=0x7fbf0000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf00005210 0x7fbf0000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf16d9d700 1 -- 172.21.15.106:0/22765194 reap_dead start 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 -- 172.21.15.106:0/22765194 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf000035b0 con 0x7fbf00004850 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf00004cd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c210 tx=0x7fbf00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a975f708d9857cf8 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08007c10 con 0x7fbf00004850 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800cdd0 con 0x7fbf00004850 2023-11-24T06:15:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.868+0000 7fbf1559a700 1 -- 172.21.15.106:0/22765194 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf08005ba0 con 0x7fbf00004850 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 -- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 msgr2=0x7fbf00004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf00004cd0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c210 tx=0x7fbf00005880 comp rx=0 tx=0).stop 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 -- 172.21.15.106:0/22765194 shutdown_connections 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/22765194 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf00004cd0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 -- 172.21.15.106:0/22765194 >> 172.21.15.106:0/22765194 conn(0x7fbf180731a0 msgr2=0x7fbf1809aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 -- 172.21.15.106:0/22765194 shutdown_connections 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.869+0000 7fbf1ce05700 1 -- 172.21.15.106:0/22765194 wait complete. 2023-11-24T06:15:06.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.870+0000 7fbf1ce05700 1 Processor -- start 2023-11-24T06:15:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.870+0000 7fbf1ce05700 1 -- start start 2023-11-24T06:15:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf180c69d0 0x7fbf180c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf180c8e20 0x7fbf180cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c6e60 con 0x7fbf00004850 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c7140 con 0x7fbf180c8e20 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf180c7420 con 0x7fbf180c69d0 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60560/0 (socket says 172.21.15.106:60560) 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 -- 172.21.15.106:0/2081289241 learned_addr learned my addr 172.21.15.106:0/2081289241 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf180c69d0 0x7fbf180c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.882 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf16d9d700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf180c8e20 0x7fbf180cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 -- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf180c69d0 msgr2=0x7fbf180c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf180c69d0 0x7fbf180c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 -- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf180c8e20 msgr2=0x7fbf180cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf180c8e20 0x7fbf180cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 -- 172.21.15.106:0/2081289241 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf180c7700 con 0x7fbf00004850 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1659c700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c011900 tx=0x7fbf0c011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c004230 con 0x7fbf00004850 2023-11-24T06:15:06.883 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c004390 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf180c79e0 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.871+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0036a0 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.872+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf180c8440 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.872+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf180c8690 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.873+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf0c003800 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.873+0000 7fbf06ffd700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 0x7fbef806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.873+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbf0c0894a0 con 0x7fbf00004850 2023-11-24T06:15:06.884 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.873+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 0x7fbef806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:06.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.874+0000 7fbf15d9b700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 0x7fbef806d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbf08001930 tx=0x7fbf08007000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:06.885 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:06.878+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf0c054850 con 0x7fbf00004850 2023-11-24T06:15:07.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.067+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf181604e0 con 0x7fbef806aed0 2023-11-24T06:15:07.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.068+0000 7fbf06ffd700 1 -- 172.21.15.106:0/2081289241 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbf08007b30 con 0x7fbef806aed0 2023-11-24T06:15:07.073 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.069+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 msgr2=0x7fbef806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 0x7fbef806d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbf08001930 tx=0x7fbf08007000 comp rx=0 tx=0).stop 2023-11-24T06:15:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 msgr2=0x7fbf1814bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c011900 tx=0x7fbf0c011cc0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 shutdown_connections 2023-11-24T06:15:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fbef806aed0 0x7fbef806d390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fbf180c8e20 0x7fbf180cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbf00004850 0x7fbf1814bff0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 --2- 172.21.15.106:0/2081289241 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fbf180c69d0 0x7fbf180c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 >> 172.21.15.106:0/2081289241 conn(0x7fbf180731a0 msgr2=0x7fbf1815f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 shutdown_connections 2023-11-24T06:15:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.070+0000 7fbf1ce05700 1 -- 172.21.15.106:0/2081289241 wait complete. 2023-11-24T06:15:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2023-11-24T06:15:07.084 INFO:tasks.ceph:Scrubbing osd.3 2023-11-24T06:15:07.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:07.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.207+0000 7fa8f0f8d700 1 Processor -- start 2023-11-24T06:15:07.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.207+0000 7fa8f0f8d700 1 -- start start 2023-11-24T06:15:07.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8f0f8d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8ec165f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8f0f8d700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0b0900 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8f0f8d700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8ec0cefb0 con 0x7fa8ec0ce4c0 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8f0f8d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b1160 con 0x7fa8ec0ae180 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e9d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8ec0b13f0 0x7fa8ec15e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40832/0 (socket says 172.21.15.106:40832) 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/2027350981 learned_addr learned my addr 172.21.15.106:0/2027350981 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8ec165f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396920964 0 0) 0x7fa8ec0b0900 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8d40057c0 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3640493149 0 0) 0x7fa8d40057c0 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 msgr2=0x7fa8ec165f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8ec165f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 >> v1:172.21.15.176:6789/0 conn(0x7fa8ec0ce4c0 legacy=0x7fa8ec0ce8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec0b0e80 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fa8e0001670 con 0x7fa8ec0b13f0 2023-11-24T06:15:07.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 >> v1:172.21.15.106:6789/0 conn(0x7fa8ec0b13f0 legacy=0x7fa8ec15e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8d4005c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4006180 0x7fa8d4006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006fa0 0x7fa8d4007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0b1160 con 0x7fa8d4006180 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400dc80 con 0x7fa8d4006fa0 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d400de40 con 0x7fa8ec0ae180 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.208+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4006180 0x7fa8d4006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8ea59c700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8d4005c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006fa0 0x7fa8d4007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 msgr2=0x7fa8d4005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec0ae180 0x7fa8d4005c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006fa0 msgr2=0x7fa8d4007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006fa0 0x7fa8d4007420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/2027350981 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d40057c0 con 0x7fa8d4006180 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006fa0 0x7fa8d4007420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:07.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4006180 0x7fa8d4006a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b17f0 tx=0x7fa8d4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff9587436584629 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e000cd40 con 0x7fa8d4006180 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e0005960 con 0x7fa8d4006180 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8e959a700 1 -- 172.21.15.106:0/2027350981 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0005d10 con 0x7fa8d4006180 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/2027350981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4006180 msgr2=0x7fa8d4006a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8f0f8d700 1 --2- 172.21.15.106:0/2027350981 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d4006180 0x7fa8d4006a60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fa8ec0b17f0 tx=0x7fa8d4007a90 comp rx=0 tx=0).stop 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.209+0000 7fa8ead9d700 1 -- 172.21.15.106:0/2027350981 reap_dead start 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.210+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/2027350981 shutdown_connections 2023-11-24T06:15:07.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.210+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/2027350981 >> 172.21.15.106:0/2027350981 conn(0x7fa8ec072710 msgr2=0x7fa8ec072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.210+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/2027350981 shutdown_connections 2023-11-24T06:15:07.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.210+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/2027350981 wait complete. 2023-11-24T06:15:07.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.211+0000 7fa8f0f8d700 1 Processor -- start 2023-11-24T06:15:07.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.211+0000 7fa8f0f8d700 1 -- start start 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006180 0x7fa8ec0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 0x7fa8ec15f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec06d7a0 0x7fa8ec06dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0c3b20 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec0c58a0 con 0x7fa8d4006180 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8ec06e160 con 0x7fa8ec06d7a0 2023-11-24T06:15:07.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 0x7fa8ec15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 0x7fa8ec15f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60582/0 (socket says 172.21.15.106:60582) 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/3628626838 learned_addr learned my addr 172.21.15.106:0/3628626838 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec06d7a0 0x7fa8ec06dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8ea59c700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006180 0x7fa8ec0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec06d7a0 msgr2=0x7fa8ec06dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa8ec06d7a0 0x7fa8ec06dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006180 msgr2=0x7fa8ec0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa8d4006180 0x7fa8ec0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ec156470 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8e9d9b700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 0x7fa8ec15f530 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c8b0 tx=0x7fa8e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0000ed0 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8e0001580 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8ec156750 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.212+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8e0004870 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.213+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8ec156d10 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.213+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa8ec0b0590 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.214+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8e00049d0 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.214+0000 7fa8daffd700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa8cc06aed0 0x7fa8cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.214+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa8e008a840 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.214+0000 7fa8ea59c700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa8cc06aed0 0x7fa8cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.214+0000 7fa8daffd700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7fa8cc070d30 0x7fa8cc073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.215+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa8cc073820 con 0x7fa8cc070d30 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.215+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa8e008f2c0 con 0x7fa8ec15f0b0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.215+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7fa8cc070d30 0x7fa8cc073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.215+0000 7fa8ea59c700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa8cc06aed0 0x7fa8cc06d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0010e0 tx=0x7fa8dc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.215+0000 7fa8ead9d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7fa8cc070d30 0x7fa8cc073150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.216+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== osd.3 v2:172.21.15.106:6800/85322157 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa8cc073820 con 0x7fa8cc070d30 2023-11-24T06:15:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.230+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 --> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa8ec067f60 con 0x7fa8cc070d30 2023-11-24T06:15:07.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8daffd700 1 -- 172.21.15.106:0/3628626838 <== osd.3 v2:172.21.15.106:6800/85322157 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fa8ec067f60 con 0x7fa8cc070d30 2023-11-24T06:15:07.233 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:07.234 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:07.234 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7fa8cc070d30 msgr2=0x7fa8cc073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6800/85322157,v1:172.21.15.106:6801/85322157] conn(0x7fa8cc070d30 0x7fa8cc073150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa8cc06aed0 msgr2=0x7fa8cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa8cc06aed0 0x7fa8cc06d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fa8dc0010e0 tx=0x7fa8dc009040 comp rx=0 tx=0).stop 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 msgr2=0x7fa8ec15f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 --2- 172.21.15.106:0/3628626838 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8ec15f0b0 0x7fa8ec15f530 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fa8e000c8b0 tx=0x7fa8e0001a00 comp rx=0 tx=0).stop 2023-11-24T06:15:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8ead9d700 1 -- 172.21.15.106:0/3628626838 reap_dead start 2023-11-24T06:15:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 shutdown_connections 2023-11-24T06:15:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 >> 172.21.15.106:0/3628626838 conn(0x7fa8ec072710 msgr2=0x7fa8ec062280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 shutdown_connections 2023-11-24T06:15:07.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.231+0000 7fa8f0f8d700 1 -- 172.21.15.106:0/3628626838 wait complete. 2023-11-24T06:15:07.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-11-24T06:15:07.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.363+0000 7f0525dcb700 1 Processor -- start 2023-11-24T06:15:07.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.363+0000 7f0525dcb700 1 -- start start 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 0x7f0520073f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05200744d0 0x7f05200ce460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200ce9a0 0x7f052006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0520074960 con 0x7f05200744d0 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f052015fb30 con 0x7f0520145510 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f0525dcb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052015fd80 con 0x7f05200ce9a0 2023-11-24T06:15:07.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.364+0000 7f051effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05200744d0 0x7f05200ce460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f05200744d0 0x7f05200ce460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60592/0 (socket says 172.21.15.106:60592) 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 -- 172.21.15.106:0/1788591923 learned_addr learned my addr 172.21.15.106:0/1788591923 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051f7fe700 1 --2- 172.21.15.106:0/1788591923 >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 0x7f0520073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051ffff700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200ce9a0 0x7f052006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 -- 172.21.15.106:0/1788591923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200ce9a0 msgr2=0x7f052006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200ce9a0 0x7f052006db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 -- 172.21.15.106:0/1788591923 >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 msgr2=0x7f0520073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 --2- 172.21.15.106:0/1788591923 >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 0x7f0520073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 -- 172.21.15.106:0/1788591923 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520160060 con 0x7f05200744d0 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051f7fe700 1 --2- 172.21.15.106:0/1788591923 >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 0x7f0520073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051effd700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200744d0 0x7f05200ce460 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05200b3780 tx=0x7f0510009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7eda46c65ddcd1 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051e7fc700 1 -- 172.21.15.106:0/1788591923 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000b870 con 0x7f05200744d0 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051e7fc700 1 -- 172.21.15.106:0/1788591923 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051000b9d0 con 0x7f05200744d0 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.365+0000 7f051e7fc700 1 -- 172.21.15.106:0/1788591923 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051000bd60 con 0x7f05200744d0 2023-11-24T06:15:07.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 -- 172.21.15.106:0/1788591923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200744d0 msgr2=0x7f05200ce460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200744d0 0x7f05200ce460 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f05200b3780 tx=0x7f0510009bd0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 -- 172.21.15.106:0/1788591923 shutdown_connections 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200ce9a0 0x7f052006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 --2- 172.21.15.106:0/1788591923 >> v2:172.21.15.176:3300/0 conn(0x7f0520145510 0x7f0520073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 --2- 172.21.15.106:0/1788591923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200744d0 0x7f05200ce460 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 -- 172.21.15.106:0/1788591923 >> 172.21.15.106:0/1788591923 conn(0x7f0520072990 msgr2=0x7f052006aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 -- 172.21.15.106:0/1788591923 shutdown_connections 2023-11-24T06:15:07.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.366+0000 7f0525dcb700 1 -- 172.21.15.106:0/1788591923 wait complete. 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.367+0000 7f0525dcb700 1 Processor -- start 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.367+0000 7f0525dcb700 1 -- start start 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 0x7f052013ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 0x7f052015aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052013e1d0 con 0x7f05200ce9a0 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05201f4d10 con 0x7f0520145510 2023-11-24T06:15:07.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05201f4190 con 0x7f05200744d0 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60598/0 (socket says 172.21.15.106:60598) 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 -- 172.21.15.106:0/2119637439 learned_addr learned my addr 172.21.15.106:0/2119637439 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051ffff700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 0x7f052015aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051f7fe700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 0x7f052013ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 -- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 msgr2=0x7f052013ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 0x7f052013ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 -- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 msgr2=0x7f052015aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 0x7f052015aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 -- 172.21.15.106:0/2119637439 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0510009550 con 0x7f05200ce9a0 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051f7fe700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 0x7f052013ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051ffff700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 0x7f052015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f051effd700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f05200b5fb0 tx=0x7f0510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0510004520 con 0x7f05200ce9a0 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051001e070 con 0x7f05200ce9a0 2023-11-24T06:15:07.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05201f4470 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.368+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05100038e0 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.369+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05201f4a30 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.370+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05200cf8d0 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.370+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0510003a40 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.370+0000 7f0507fff700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 0x7f050c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.370+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0510020070 con 0x7f05200ce9a0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.370+0000 7f051f7fe700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 0x7f050c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.379 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.371+0000 7f051f7fe700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 0x7f050c06d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0514006fd0 tx=0x7f0514008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.380 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.375+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0510055d30 con 0x7f05200ce9a0 2023-11-24T06:15:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.565+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f05200cee30 con 0x7f050c06aed0 2023-11-24T06:15:07.568 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.566+0000 7f0507fff700 1 -- 172.21.15.106:0/2119637439 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f051400c050 con 0x7f050c06aed0 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 msgr2=0x7f050c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 0x7f050c06d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0514006fd0 tx=0x7f0514008040 comp rx=0 tx=0).stop 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 msgr2=0x7f052013e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f05200b5fb0 tx=0x7f0510004750 comp rx=0 tx=0).stop 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 shutdown_connections 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f050c06aed0 0x7f050c06d390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.571 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f0520145510 0x7f052015aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f05200744d0 0x7f052013ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 --2- 172.21.15.106:0/2119637439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05200ce9a0 0x7f052013e860 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 >> 172.21.15.106:0/2119637439 conn(0x7f0520072990 msgr2=0x7f0520141750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 shutdown_connections 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.568+0000 7f0525dcb700 1 -- 172.21.15.106:0/2119637439 wait complete. 2023-11-24T06:15:07.572 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2023-11-24T06:15:07.582 INFO:tasks.ceph:Scrubbing osd.4 2023-11-24T06:15:07.583 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:07.706 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.704+0000 7fafa3bcc700 1 Processor -- start 2023-11-24T06:15:07.707 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.704+0000 7fafa3bcc700 1 -- start start 2023-11-24T06:15:07.710 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa3bcc700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7faf9c0cf040 0x7faf9c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa3bcc700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0d01c0 con 0x7faf9c0702e0 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa3bcc700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c070910 con 0x7faf9c0d21c0 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa3bcc700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c070bf0 con 0x7faf9c0cf040 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa1167700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faf9c0702e0 0x7faf9c0d1ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40866/0 (socket says 172.21.15.106:40866) 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa1167700 1 -- 172.21.15.106:0/3924555134 learned_addr learned my addr 172.21.15.106:0/3924555134 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa1968700 1 --2- 172.21.15.106:0/3924555134 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0cf040 0x7faf9c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832169549 0 0) 0x7faf9c0d01c0 con 0x7faf9c0702e0 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf880035b0 con 0x7faf9c0702e0 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1493065110 0 0) 0x7faf880035b0 con 0x7faf9c0702e0 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0cf040 msgr2=0x7faf9c06fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 --2- 172.21.15.106:0/3924555134 >> v2:172.21.15.176:3300/0 conn(0x7faf9c0cf040 0x7faf9c06fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 >> v1:172.21.15.176:6789/0 conn(0x7faf9c0d21c0 legacy=0x7faf9c0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c0aebb0 con 0x7faf9c0702e0 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7faf8c001670 con 0x7faf9c0702e0 2023-11-24T06:15:07.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.705+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 >> v1:172.21.15.106:6789/0 conn(0x7faf9c0702e0 legacy=0x7faf9c0d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88003a00 0x7faf88003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 0x7faf88004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf88005210 0x7faf8800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c070bf0 con 0x7faf88004850 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8800c0b0 con 0x7faf88003a00 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8800c270 con 0x7faf88005210 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 0x7faf88004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1968700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88003a00 0x7faf88003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa2169700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf88005210 0x7faf8800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 -- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf88005210 msgr2=0x7faf8800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf88005210 0x7faf8800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 -- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88003a00 msgr2=0x7faf88003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88003a00 0x7faf88003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 -- 172.21.15.106:0/3924555134 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880035b0 con 0x7faf88004850 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa2169700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf88005210 0x7faf8800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:07.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa2169700 1 -- 172.21.15.106:0/3924555134 reap_dead start 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa1167700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 0x7faf88004cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c240 tx=0x7faf88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb734dd8d04063a server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c007c10 con 0x7faf88004850 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c00cde0 con 0x7faf88004850 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.706+0000 7fafa0966700 1 -- 172.21.15.106:0/3924555134 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c005ba0 con 0x7faf88004850 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 -- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 msgr2=0x7faf88004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 0x7faf88004cd0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7faf8c00c240 tx=0x7faf88005880 comp rx=0 tx=0).stop 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 -- 172.21.15.106:0/3924555134 shutdown_connections 2023-11-24T06:15:07.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 --2- 172.21.15.106:0/3924555134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf88004850 0x7faf88004cd0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 -- 172.21.15.106:0/3924555134 >> 172.21.15.106:0/3924555134 conn(0x7faf9c09aa00 msgr2=0x7faf9c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 -- 172.21.15.106:0/3924555134 shutdown_connections 2023-11-24T06:15:07.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.707+0000 7fafa3bcc700 1 -- 172.21.15.106:0/3924555134 wait complete. 2023-11-24T06:15:07.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.708+0000 7fafa3bcc700 1 Processor -- start 2023-11-24T06:15:07.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.708+0000 7fafa3bcc700 1 -- start start 2023-11-24T06:15:07.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88004850 0x7faf9c1f3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 0x7faf9c06c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f1190 0x7faf9c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f7ee0 con 0x7faf9c1f0d10 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f7360 con 0x7faf88004850 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f7640 con 0x7faf9c1f1190 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 0x7faf9c06c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 0x7faf9c06c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60616/0 (socket says 172.21.15.106:60616) 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 -- 172.21.15.106:0/2548168143 learned_addr learned my addr 172.21.15.106:0/2548168143 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa2169700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f1190 0x7faf9c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 -- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f1190 msgr2=0x7faf9c15bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7faf9c1f1190 0x7faf9c15bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 -- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88004850 msgr2=0x7faf9c1f3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7faf88004850 0x7faf9c1f3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c1f7920 con 0x7faf9c1f0d10 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa1167700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 0x7faf9c06c700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf8800c080 tx=0x7faf8c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0070d0 con 0x7faf9c1f0d10 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c007230 con 0x7faf9c1f0d10 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0075a0 con 0x7faf9c1f0d10 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.709+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c1f7c00 con 0x7faf9c1f0d10 2023-11-24T06:15:07.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.710+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c1f6f80 con 0x7faf9c1f0d10 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.710+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf9c0cf420 con 0x7faf9c1f0d10 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.711+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faf8c01e430 con 0x7faf9c1f0d10 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.711+0000 7faf927fc700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faf8006aed0 0x7faf8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.711+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7faf8c08ac80 con 0x7faf9c1f0d10 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.711+0000 7fafa1968700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faf8006aed0 0x7faf8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.711+0000 7faf927fc700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7faf80070d30 0x7faf80073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.712+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf80073820 con 0x7faf80070d30 2023-11-24T06:15:07.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.712+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf8c08b0d0 con 0x7faf9c1f0d10 2023-11-24T06:15:07.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.712+0000 7fafa1968700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faf8006aed0 0x7faf8006d390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf98006f10 tx=0x7faf98006e80 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.712+0000 7fafa2169700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7faf80070d30 0x7faf80073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.712+0000 7fafa2169700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7faf80070d30 0x7faf80073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.713+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== osd.4 v2:172.21.15.176:6824/883773591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faf80073820 con 0x7faf80070d30 2023-11-24T06:15:07.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.728+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 --> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7faf9c067f60 con 0x7faf80070d30 2023-11-24T06:15:07.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7faf927fc700 1 -- 172.21.15.106:0/2548168143 <== osd.4 v2:172.21.15.176:6824/883773591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7faf9c067f60 con 0x7faf80070d30 2023-11-24T06:15:07.732 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:07.732 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:07.732 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:07.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7faf80070d30 msgr2=0x7faf80073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.176:6824/883773591,v1:172.21.15.176:6825/883773591] conn(0x7faf80070d30 0x7faf80073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faf8006aed0 msgr2=0x7faf8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7faf8006aed0 0x7faf8006d390 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf98006f10 tx=0x7faf98006e80 comp rx=0 tx=0).stop 2023-11-24T06:15:07.733 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 msgr2=0x7faf9c06c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 --2- 172.21.15.106:0/2548168143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf9c1f0d10 0x7faf9c06c700 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7faf8800c080 tx=0x7faf8c001a00 comp rx=0 tx=0).stop 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa2169700 1 -- 172.21.15.106:0/2548168143 reap_dead start 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 shutdown_connections 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 >> 172.21.15.106:0/2548168143 conn(0x7faf9c09aa00 msgr2=0x7faf9c15db30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 shutdown_connections 2023-11-24T06:15:07.734 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.729+0000 7fafa3bcc700 1 -- 172.21.15.106:0/2548168143 wait complete. 2023-11-24T06:15:07.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-11-24T06:15:07.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.862+0000 7fc4b2088700 1 Processor -- start 2023-11-24T06:15:07.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.862+0000 7fc4b2088700 1 -- start start 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4b2088700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4ac0af1e0 0x7fc4ac0622a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4b2088700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac15c540 con 0x7fc4ac0b04b0 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4b2088700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ac0b2ee0 con 0x7fc4ac15c160 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4b2088700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ac0add40 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4abfff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc4ac0af1e0 0x7fc4ac0622a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aaffd700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc4ac0b04b0 0x7fc4ac163c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40888/0 (socket says 172.21.15.106:40888) 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aaffd700 1 -- 172.21.15.106:0/2043151176 learned_addr learned my addr 172.21.15.106:0/2043151176 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:07.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4abfff700 1 -- 172.21.15.106:0/2043151176 >> v1:172.21.15.176:6789/0 conn(0x7fc4ac15c160 legacy=0x7fc4ac0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:07.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4abfff700 1 -- 172.21.15.106:0/2043151176 >> v1:172.21.15.106:6789/0 conn(0x7fc4ac0b04b0 legacy=0x7fc4ac163c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4abfff700 1 -- 172.21.15.106:0/2043151176 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ac0ad410 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aa7fc700 1 -- 172.21.15.106:0/2043151176 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2481213237 0 0) 0x7fc4ac15c540 con 0x7fc4ac0b04b0 2023-11-24T06:15:07.869 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4abfff700 1 --2- 172.21.15.106:0/2043151176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac0622a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009840 tx=0x7fc49c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfdc7a44c84f78f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aa7fc700 1 -- 172.21.15.106:0/2043151176 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c004230 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aa7fc700 1 -- 172.21.15.106:0/2043151176 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc49c004390 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.863+0000 7fc4aa7fc700 1 -- 172.21.15.106:0/2043151176 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49c0036a0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 -- 172.21.15.106:0/2043151176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 msgr2=0x7fc4ac0622a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2043151176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac0622a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fc49c009840 tx=0x7fc49c009b50 comp rx=0 tx=0).stop 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 -- 172.21.15.106:0/2043151176 shutdown_connections 2023-11-24T06:15:07.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2043151176 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac0622a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 -- 172.21.15.106:0/2043151176 >> 172.21.15.106:0/2043151176 conn(0x7fc4ac0b57b0 msgr2=0x7fc4ac0b5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:07.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 -- 172.21.15.106:0/2043151176 shutdown_connections 2023-11-24T06:15:07.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.864+0000 7fc4b2088700 1 -- 172.21.15.106:0/2043151176 wait complete. 2023-11-24T06:15:07.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.865+0000 7fc4b2088700 1 Processor -- start 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.865+0000 7fc4b2088700 1 -- start start 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 0x7fc4ac0cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ac15c160 0x7fc4ac157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0cd040 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0cc1b0 con 0x7fc4ac15c160 2023-11-24T06:15:07.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4b2088700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ac0cc3c0 con 0x7fc4ac0b04b0 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60630/0 (socket says 172.21.15.106:60630) 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 -- 172.21.15.106:0/2841083276 learned_addr learned my addr 172.21.15.106:0/2841083276 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4abfff700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ac15c160 0x7fc4ac157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4aaffd700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 0x7fc4ac0cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 -- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 msgr2=0x7fc4ac0cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 0x7fc4ac0cbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.875 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 -- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ac15c160 msgr2=0x7fc4ac157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ac15c160 0x7fc4ac157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.866+0000 7fc4ab7fe700 1 -- 172.21.15.106:0/2841083276 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc49c0094a0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4aaffd700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 0x7fc4ac0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4ab7fe700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ba50 tx=0x7fc4a400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a400cab0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a400cc50 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.876 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a4014440 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ac0cc6a0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.867+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ac0ccc60 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.868+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ac0cd2b0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.868+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4a40145a0 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.869+0000 7fc4a3fff700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.869+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4a4089020 con 0x7fc4ac0af1e0 2023-11-24T06:15:07.877 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.869+0000 7fc4aaffd700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:07.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.869+0000 7fc4aaffd700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 0x7fc48c06d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac15c910 tx=0x7fc494009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:07.878 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:07.873+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4a40543f0 con 0x7fc4ac0af1e0 2023-11-24T06:15:08.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.068+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4ac0ad9d0 con 0x7fc48c06aed0 2023-11-24T06:15:08.071 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.069+0000 7fc4a3fff700 1 -- 172.21.15.106:0/2841083276 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc494001cc0 con 0x7fc48c06aed0 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 msgr2=0x7fc48c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 0x7fc48c06d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac15c910 tx=0x7fc494009040 comp rx=0 tx=0).stop 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 msgr2=0x7fc4ac15a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fc4a400ba50 tx=0x7fc4a400be10 comp rx=0 tx=0).stop 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 shutdown_connections 2023-11-24T06:15:08.074 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fc48c06aed0 0x7fc48c06d390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fc4ac15c160 0x7fc4ac157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4ac0af1e0 0x7fc4ac15a970 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 --2- 172.21.15.106:0/2841083276 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fc4ac0b04b0 0x7fc4ac0cbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 >> 172.21.15.106:0/2841083276 conn(0x7fc4ac0b57b0 msgr2=0x7fc4ac0726e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 shutdown_connections 2023-11-24T06:15:08.075 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.071+0000 7fc4b2088700 1 -- 172.21.15.106:0/2841083276 wait complete. 2023-11-24T06:15:08.076 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2023-11-24T06:15:08.085 INFO:tasks.ceph:Scrubbing osd.5 2023-11-24T06:15:08.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:08.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.207+0000 7f1e23e42700 1 Processor -- start 2023-11-24T06:15:08.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.207+0000 7f1e23e42700 1 -- start start 2023-11-24T06:15:08.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e23e42700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e1c0cf040 0x7f1e1c06fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e23e42700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 0x7f1e1c0af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e23e42700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0d01c0 con 0x7f1e1c0702e0 2023-11-24T06:15:08.212 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e23e42700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c070910 con 0x7f1e1c0cf040 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e23e42700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c070bf0 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e1c0cf040 0x7f1e1c06fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e1c0cf040 0x7f1e1c06fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60638/0 (socket says 172.21.15.106:60638) 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 -- 172.21.15.106:0/1514671002 learned_addr learned my addr 172.21.15.106:0/1514671002 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e223df700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 0x7f1e1c0af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 -- 172.21.15.106:0/1514671002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 msgr2=0x7f1e1c0af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 0x7f1e1c0af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.213 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 -- 172.21.15.106:0/1514671002 >> v1:172.21.15.176:6789/0 conn(0x7f1e1c0702e0 legacy=0x7f1e1c0d1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e21bde700 1 -- 172.21.15.106:0/1514671002 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c0aebb0 con 0x7f1e1c0cf040 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.208+0000 7f1e223df700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 0x7f1e1c0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e21bde700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c06fda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d043093682ab41 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e20bdc700 1 -- 172.21.15.106:0/1514671002 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00b8a0 con 0x7f1e1c0cf040 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e20bdc700 1 -- 172.21.15.106:0/1514671002 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c00ba00 con 0x7f1e1c0cf040 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e20bdc700 1 -- 172.21.15.106:0/1514671002 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c00bd90 con 0x7f1e1c0cf040 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 -- 172.21.15.106:0/1514671002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0cf040 msgr2=0x7f1e1c06fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c06fda0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c0098f0 tx=0x7f1e0c009c00 comp rx=0 tx=0).stop 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 -- 172.21.15.106:0/1514671002 shutdown_connections 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0d21c0 0x7f1e1c0af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1514671002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c06fda0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 -- 172.21.15.106:0/1514671002 >> 172.21.15.106:0/1514671002 conn(0x7f1e1c09aa00 msgr2=0x7f1e1c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 -- 172.21.15.106:0/1514671002 shutdown_connections 2023-11-24T06:15:08.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.209+0000 7f1e23e42700 1 -- 172.21.15.106:0/1514671002 wait complete. 2023-11-24T06:15:08.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 Processor -- start 2023-11-24T06:15:08.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 -- start start 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0702e0 0x7f1e1c0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c0b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 0x7f1e1c14fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c6850 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c6500 con 0x7f1e1c0cf040 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e23e42700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c5bb0 con 0x7f1e1c0702e0 2023-11-24T06:15:08.219 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e223df700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 0x7f1e1c14fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e223df700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 0x7f1e1c14fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60648/0 (socket says 172.21.15.106:60648) 2023-11-24T06:15:08.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.211+0000 7f1e223df700 1 -- 172.21.15.106:0/1471532935 learned_addr learned my addr 172.21.15.106:0/1471532935 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.220 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e213dd700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c0b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 -- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0702e0 msgr2=0x7f1e1c0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f1e1c0702e0 0x7f1e1c0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.222 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 -- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e1c0cf040 msgr2=0x7f1e1c0b2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f1e1c0cf040 0x7f1e1c0b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e0c009550 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e223df700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 0x7f1e1c14fbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1e14007df0 tx=0x7f1e1400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400ddd0 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1400f040 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c0c5e90 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.223 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14003c60 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.212+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c0c57f0 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.213+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1e1c067f60 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.213+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1e14004030 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e127fc700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1e0006aed0 0x7f1e0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e14089ab0 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e21bde700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1e0006aed0 0x7f1e0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.224 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e127fc700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7f1e00070d30 0x7f1e00073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1e00073820 con 0x7f1e00070d30 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1e14089f00 con 0x7f1e1c0d21c0 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e213dd700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7f1e00070d30 0x7f1e00073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.214+0000 7f1e21bde700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1e0006aed0 0x7f1e0006d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c010000 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.215+0000 7f1e213dd700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7f1e00070d30 0x7f1e00073150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.216+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== osd.5 v2:172.21.15.176:6816/3891434680 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1e00073820 con 0x7f1e00070d30 2023-11-24T06:15:08.232 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.230+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 --> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1e1c06eeb0 con 0x7f1e00070d30 2023-11-24T06:15:08.233 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e127fc700 1 -- 172.21.15.106:0/1471532935 <== osd.5 v2:172.21.15.176:6816/3891434680 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f1e1c06eeb0 con 0x7f1e00070d30 2023-11-24T06:15:08.233 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:08.234 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:08.234 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7f1e00070d30 msgr2=0x7f1e00073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.176:6816/3891434680,v1:172.21.15.176:6817/3891434680] conn(0x7f1e00070d30 0x7f1e00073150 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1e0006aed0 msgr2=0x7f1e0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f1e0006aed0 0x7f1e0006d390 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c000c00 tx=0x7f1e0c010000 comp rx=0 tx=0).stop 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 msgr2=0x7f1e1c14fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 --2- 172.21.15.106:0/1471532935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c0d21c0 0x7f1e1c14fbe0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f1e14007df0 tx=0x7f1e1400d3b0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.235 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e223df700 1 -- 172.21.15.106:0/1471532935 reap_dead start 2023-11-24T06:15:08.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 shutdown_connections 2023-11-24T06:15:08.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 >> 172.21.15.106:0/1471532935 conn(0x7f1e1c09aa00 msgr2=0x7f1e1c0ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 shutdown_connections 2023-11-24T06:15:08.236 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.231+0000 7f1e23e42700 1 -- 172.21.15.106:0/1471532935 wait complete. 2023-11-24T06:15:08.245 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-11-24T06:15:08.365 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.363+0000 7fda23f92700 1 Processor -- start 2023-11-24T06:15:08.366 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.363+0000 7fda23f92700 1 -- start start 2023-11-24T06:15:08.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda23f92700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda1c15e2a0 0x7fda1c06ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda23f92700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 0x7fda1c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda23f92700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda1c06e7f0 con 0x7fda1c073f90 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda23f92700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1c06dec0 con 0x7fda1c15e2a0 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda23f92700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c06e1a0 con 0x7fda1c0ce090 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda2152d700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 0x7fda1c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda21d2e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda1c15e2a0 0x7fda1c06ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda21d2e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fda1c15e2a0 0x7fda1c06ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.176:3300/0 says I am v2:172.21.15.106:40892/0 (socket says 172.21.15.106:40892) 2023-11-24T06:15:08.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda2252f700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7fda1c073f90 0x7fda1c0cf470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:35164/0 (socket says 172.21.15.106:35164) 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.364+0000 7fda21d2e700 1 -- 172.21.15.106:0/2676002368 learned_addr learned my addr 172.21.15.106:0/2676002368 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda21d2e700 1 -- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 msgr2=0x7fda1c06ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda21d2e700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 0x7fda1c06ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda21d2e700 1 -- 172.21.15.106:0/2676002368 >> v1:172.21.15.176:6789/0 conn(0x7fda1c073f90 legacy=0x7fda1c0cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda20d2c700 1 -- 172.21.15.106:0/2676002368 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1220854267 0 0) 0x7fda1c06e7f0 con 0x7fda1c073f90 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda21d2e700 1 -- 172.21.15.106:0/2676002368 --> v2:172.21.15.176:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda1c06e480 con 0x7fda1c15e2a0 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda2152d700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 0x7fda1c06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-24T06:15:08.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda21d2e700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c15e2a0 0x7fda1c06ba70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda180098f0 tx=0x7fda18009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcf80f594f92af85 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda20d2c700 1 -- 172.21.15.106:0/2676002368 <== mon.1 v2:172.21.15.176:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011830 con 0x7fda1c15e2a0 2023-11-24T06:15:08.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda20d2c700 1 -- 172.21.15.106:0/2676002368 <== mon.1 v2:172.21.15.176:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda18011990 con 0x7fda1c15e2a0 2023-11-24T06:15:08.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda20d2c700 1 -- 172.21.15.106:0/2676002368 <== mon.1 v2:172.21.15.176:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda18011d20 con 0x7fda1c15e2a0 2023-11-24T06:15:08.372 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda23f92700 1 -- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c15e2a0 msgr2=0x7fda1c06ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda23f92700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c15e2a0 0x7fda1c06ba70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fda180098f0 tx=0x7fda18009c00 comp rx=0 tx=0).stop 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.365+0000 7fda23f92700 1 -- 172.21.15.106:0/2676002368 shutdown_connections 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.366+0000 7fda23f92700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c15e2a0 0x7fda1c06ba70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.366+0000 7fda23f92700 1 --2- 172.21.15.106:0/2676002368 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c0ce090 0x7fda1c06ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.366+0000 7fda23f92700 1 -- 172.21.15.106:0/2676002368 >> 172.21.15.106:0/2676002368 conn(0x7fda1c0cd570 msgr2=0x7fda1c0cd980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.366+0000 7fda23f92700 1 -- 172.21.15.106:0/2676002368 shutdown_connections 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.366+0000 7fda23f92700 1 -- 172.21.15.106:0/2676002368 wait complete. 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.367+0000 7fda23f92700 1 Processor -- start 2023-11-24T06:15:08.373 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.367+0000 7fda23f92700 1 -- start start 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.367+0000 7fda23f92700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c073f90 0x7fda1c15e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c15e2a0 0x7fda1c1f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15f150 con 0x7fda1c0ce090 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15f430 con 0x7fda1c073f90 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c15f710 con 0x7fda1c15e2a0 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.374 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60662/0 (socket says 172.21.15.106:60662) 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 -- 172.21.15.106:0/2685390130 learned_addr learned my addr 172.21.15.106:0/2685390130 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda21d2e700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c073f90 0x7fda1c15e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 -- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c15e2a0 msgr2=0x7fda1c1f38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c15e2a0 0x7fda1c1f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 -- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c073f90 msgr2=0x7fda1c15e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c073f90 0x7fda1c15e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 -- 172.21.15.106:0/2685390130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0094a0 con 0x7fda1c0ce090 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda2152d700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00ebe0 tx=0x7fda0c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.375 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c009800 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00c910 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00cc80 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda18009550 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.368+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c15fcd0 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.369+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c15fe90 con 0x7fda1c0ce090 2023-11-24T06:15:08.376 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.370+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fda0c013470 con 0x7fda1c0ce090 2023-11-24T06:15:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.370+0000 7fda127fc700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 0x7fda0006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.370+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fda0c089430 con 0x7fda1c0ce090 2023-11-24T06:15:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.370+0000 7fda21d2e700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 0x7fda0006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.377 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.371+0000 7fda21d2e700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 0x7fda0006d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda18009130 tx=0x7fda18008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.378 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.375+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fda0c054760 con 0x7fda1c0ce090 2023-11-24T06:15:08.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.564+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fda1c0ce650 con 0x7fda0006aed0 2023-11-24T06:15:08.567 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.564+0000 7fda127fc700 1 -- 172.21.15.106:0/2685390130 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fda18011c00 con 0x7fda0006aed0 2023-11-24T06:15:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 msgr2=0x7fda0006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 0x7fda0006d390 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fda18009130 tx=0x7fda18008030 comp rx=0 tx=0).stop 2023-11-24T06:15:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 msgr2=0x7fda1c1601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fda0c00ebe0 tx=0x7fda0c00eef0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.569 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 shutdown_connections 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fda0006aed0 0x7fda0006d390 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fda1c15e2a0 0x7fda1c1f38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fda1c073f90 0x7fda1c15e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 --2- 172.21.15.106:0/2685390130 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda1c0ce090 0x7fda1c1601f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 >> 172.21.15.106:0/2685390130 conn(0x7fda1c0cd570 msgr2=0x7fda1c0b1ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 shutdown_connections 2023-11-24T06:15:08.570 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.566+0000 7fda23f92700 1 -- 172.21.15.106:0/2685390130 wait complete. 2023-11-24T06:15:08.571 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2023-11-24T06:15:08.581 INFO:tasks.ceph:Scrubbing osd.6 2023-11-24T06:15:08.581 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:08.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.702+0000 7f3c5066c700 1 Processor -- start 2023-11-24T06:15:08.705 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.702+0000 7f3c5066c700 1 -- start start 2023-11-24T06:15:08.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c5066c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c480b1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c5066c700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7f3c480624b0 0x7f3c4815c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.711 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c5066c700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c480d0ec0 con 0x7f3c480cc820 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c5066c700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c480d0380 con 0x7f3c480624b0 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c5066c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b1940 con 0x7f3c480b1020 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4dc07700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3c480cc820 0x7f3c4815fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40930/0 (socket says 172.21.15.106:40930) 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4dc07700 1 -- 172.21.15.106:0/4190964156 learned_addr learned my addr 172.21.15.106:0/4190964156 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/4190964156 >> v2:172.21.15.176:3300/0 conn(0x7f3c480624b0 0x7f3c4815c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.712 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4e408700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c480b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570937216 0 0) 0x7f3c480d0ec0 con 0x7f3c480cc820 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c340035b0 con 0x7f3c480cc820 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4097083089 0 0) 0x7f3c340035b0 con 0x7f3c480cc820 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 msgr2=0x7f3c480b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c480b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 >> v2:172.21.15.176:3300/0 conn(0x7f3c480624b0 msgr2=0x7f3c4815c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 --2- 172.21.15.106:0/4190964156 >> v2:172.21.15.176:3300/0 conn(0x7f3c480624b0 0x7f3c4815c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.713 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480d0620 con 0x7f3c480cc820 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7f3c38001670 con 0x7f3c480cc820 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 >> v1:172.21.15.106:6789/0 conn(0x7f3c480cc820 legacy=0x7f3c4815fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c34003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c34003f80 0x7f3c34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c34004d90 0x7f3c34005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480d0380 con 0x7f3c34004d90 2023-11-24T06:15:08.714 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.703+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b1940 con 0x7f3c34003f80 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400ba10 con 0x7f3c480b1020 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c34004d90 0x7f3c34005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4dc07700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c34003f80 0x7f3c34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4e408700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c34003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 -- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 msgr2=0x7f3c34003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c480b1020 0x7f3c34003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 -- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c34003f80 msgr2=0x7f3c34004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.715 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c34003f80 0x7f3c34004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 -- 172.21.15.106:0/4190964156 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340035b0 con 0x7f3c34004d90 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c34004d90 0x7f3c34005210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009fc0 tx=0x7f3c34005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e45ab35c6c23b71 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4000ebd0 con 0x7f3c34004d90 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4000f040 con 0x7f3c34004d90 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.704+0000 7f3c4d406700 1 -- 172.21.15.106:0/4190964156 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40014480 con 0x7f3c34004d90 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 -- 172.21.15.106:0/4190964156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c34004d90 msgr2=0x7f3c34005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.716 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 --2- 172.21.15.106:0/4190964156 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c34004d90 0x7f3c34005210 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f3c40009fc0 tx=0x7f3c34005880 comp rx=0 tx=0).stop 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c4ec09700 1 -- 172.21.15.106:0/4190964156 reap_dead start 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 -- 172.21.15.106:0/4190964156 shutdown_connections 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 -- 172.21.15.106:0/4190964156 >> 172.21.15.106:0/4190964156 conn(0x7f3c48072710 msgr2=0x7f3c48072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 -- 172.21.15.106:0/4190964156 shutdown_connections 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.705+0000 7f3c5066c700 1 -- 172.21.15.106:0/4190964156 wait complete. 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.706+0000 7f3c5066c700 1 Processor -- start 2023-11-24T06:15:08.717 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.706+0000 7f3c5066c700 1 -- start start 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c34004d90 0x7f3c4814b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c481601a0 0x7f3c480b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 0x7f3c480c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480c9f10 con 0x7f3c480c9560 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480ae3a0 con 0x7f3c481601a0 2023-11-24T06:15:08.718 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480b5340 con 0x7f3c34004d90 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 0x7f3c480c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 0x7f3c480c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60682/0 (socket says 172.21.15.106:60682) 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 -- 172.21.15.106:0/146320232 learned_addr learned my addr 172.21.15.106:0/146320232 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4dc07700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c481601a0 0x7f3c480b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4e408700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c34004d90 0x7f3c4814b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 -- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c34004d90 msgr2=0x7f3c4814b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f3c34004d90 0x7f3c4814b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.719 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 -- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c481601a0 msgr2=0x7f3c480b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f3c481601a0 0x7f3c480b1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c480b23d0 con 0x7f3c480c9560 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c4ec09700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 0x7f3c480c99d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3c40002230 tx=0x7f3c40009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007000 con 0x7f3c480c9560 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400148b0 con 0x7f3c480c9560 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.707+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c481606a0 con 0x7f3c480c9560 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.708+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40014c60 con 0x7f3c480c9560 2023-11-24T06:15:08.720 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.708+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480b58b0 con 0x7f3c480c9560 2023-11-24T06:15:08.721 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.708+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3c480c3b70 con 0x7f3c480c9560 2023-11-24T06:15:08.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c40024070 con 0x7f3c480c9560 2023-11-24T06:15:08.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3c2c06aed0 0x7f3c2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.722 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c4e408700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3c2c06aed0 0x7f3c2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c4008ac50 con 0x7f3c480c9560 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7f3c2c070d30 0x7f3c2c073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3c2c073820 con 0x7f3c2c070d30 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.709+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c4008f2a0 con 0x7f3c480c9560 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.710+0000 7f3c4e408700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3c2c06aed0 0x7f3c2c06d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009c60 tx=0x7f3c44009210 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.710+0000 7f3c4dc07700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7f3c2c070d30 0x7f3c2c073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.710+0000 7f3c4dc07700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7f3c2c070d30 0x7f3c2c073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.723 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.711+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== osd.6 v2:172.21.15.176:6808/4287270642 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3c2c073820 con 0x7f3c2c070d30 2023-11-24T06:15:08.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.725+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 --> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3c480d0be0 con 0x7f3c2c070d30 2023-11-24T06:15:08.728 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c3effd700 1 -- 172.21.15.106:0/146320232 <== osd.6 v2:172.21.15.176:6808/4287270642 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3c38004870 con 0x7f3c2c070d30 2023-11-24T06:15:08.729 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:08.729 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:08.729 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:08.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7f3c2c070d30 msgr2=0x7f3c2c073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.176:6808/4287270642,v1:172.21.15.176:6809/4287270642] conn(0x7f3c2c070d30 0x7f3c2c073150 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.730 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3c2c06aed0 msgr2=0x7f3c2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f3c2c06aed0 0x7f3c2c06d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3c44009c60 tx=0x7f3c44009210 comp rx=0 tx=0).stop 2023-11-24T06:15:08.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 msgr2=0x7f3c480c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 --2- 172.21.15.106:0/146320232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c480c9560 0x7f3c480c99d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f3c40002230 tx=0x7f3c40009750 comp rx=0 tx=0).stop 2023-11-24T06:15:08.731 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c4ec09700 1 -- 172.21.15.106:0/146320232 reap_dead start 2023-11-24T06:15:08.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 shutdown_connections 2023-11-24T06:15:08.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.726+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 >> 172.21.15.106:0/146320232 conn(0x7f3c48072710 msgr2=0x7f3c480c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.727+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 shutdown_connections 2023-11-24T06:15:08.732 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.727+0000 7f3c5066c700 1 -- 172.21.15.106:0/146320232 wait complete. 2023-11-24T06:15:08.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-11-24T06:15:08.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.859+0000 7f4bd23c1700 1 Processor -- start 2023-11-24T06:15:08.862 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.859+0000 7f4bd23c1700 1 -- start start 2023-11-24T06:15:08.864 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd23c1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd23c1700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd23c1700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bcc0b1d40 con 0x7f4bcc0d1b30 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd23c1700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bcc0b28c0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd23c1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc06c000 con 0x7f4bcc15ddd0 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bcb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bcb7fe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60688/0 (socket says 172.21.15.106:60688) 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bd095e700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4bcc0d1b30 0x7f4bcc161c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40950/0 (socket says 172.21.15.106:40950) 2023-11-24T06:15:08.865 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.860+0000 7f4bcb7fe700 1 -- 172.21.15.106:0/3646595927 learned_addr learned my addr 172.21.15.106:0/3646595927 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcb7fe700 1 -- 172.21.15.106:0/3646595927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 msgr2=0x7f4bcc0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcb7fe700 1 --2- 172.21.15.106:0/3646595927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcb7fe700 1 -- 172.21.15.106:0/3646595927 >> v1:172.21.15.106:6789/0 conn(0x7f4bcc0d1b30 legacy=0x7f4bcc161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcb7fe700 1 -- 172.21.15.106:0/3646595927 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc0b1f90 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcaffd700 1 -- 172.21.15.106:0/3646595927 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2778178780 0 0) 0x7f4bcc0b1d40 con 0x7f4bcc0d1b30 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcb7fe700 1 --2- 172.21.15.106:0/3646595927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0098f0 tx=0x7f4bbc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36219a31d79ee347 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.866 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcaffd700 1 -- 172.21.15.106:0/3646595927 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc00b8a0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcaffd700 1 -- 172.21.15.106:0/3646595927 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bbc00ba00 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bcaffd700 1 -- 172.21.15.106:0/3646595927 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bbc00bd90 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bd23c1700 1 -- 172.21.15.106:0/3646595927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 msgr2=0x7f4bcc0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.861+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/3646595927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0098f0 tx=0x7f4bbc009c00 comp rx=0 tx=0).stop 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 -- 172.21.15.106:0/3646595927 shutdown_connections 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/3646595927 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.867 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/3646595927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc0cf000 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 -- 172.21.15.106:0/3646595927 >> 172.21.15.106:0/3646595927 conn(0x7f4bcc0731a0 msgr2=0x7f4bcc09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:08.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 -- 172.21.15.106:0/3646595927 shutdown_connections 2023-11-24T06:15:08.868 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.862+0000 7f4bd23c1700 1 -- 172.21.15.106:0/3646595927 wait complete. 2023-11-24T06:15:08.870 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.863+0000 7f4bd23c1700 1 Processor -- start 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.863+0000 7f4bd23c1700 1 -- start start 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc0d1b30 0x7f4bcc157d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc15a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1590f0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1593d0 con 0x7f4bcc0d1b30 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bcc1596b0 con 0x7f4bcc15ddd0 2023-11-24T06:15:08.871 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60696/0 (socket says 172.21.15.106:60696) 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 -- 172.21.15.106:0/1771073199 learned_addr learned my addr 172.21.15.106:0/1771073199 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 -- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 msgr2=0x7f4bcc15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc15a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 -- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc0d1b30 msgr2=0x7f4bcc157d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc0d1b30 0x7f4bcc157d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:08.872 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 -- 172.21.15.106:0/1771073199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc009550 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd095e700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4002230 tx=0x7f4bc400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc400ac20 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc400ada0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bcc0b2ed0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc4007310 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.864+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bcc159c70 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.865+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bcc067f60 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.873 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.866+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4bc4007470 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.866+0000 7f4bc8ff9700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 0x7f4bb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:08.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.866+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4bc40891d0 con 0x7f4bcc15e1b0 2023-11-24T06:15:08.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.866+0000 7f4bcbfff700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 0x7f4bb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:08.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.867+0000 7f4bcbfff700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 0x7f4bb806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00097b0 tx=0x7f4bc0006d20 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:08.874 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:08.871+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4bc4054580 con 0x7f4bcc15e1b0 2023-11-24T06:15:09.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.059+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bcc0b2d50 con 0x7f4bb806aed0 2023-11-24T06:15:09.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.060+0000 7f4bc8ff9700 1 -- 172.21.15.106:0/1771073199 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4bc0013400 con 0x7f4bb806aed0 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 msgr2=0x7f4bb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 0x7f4bb806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4bc00097b0 tx=0x7f4bc0006d20 comp rx=0 tx=0).stop 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 msgr2=0x7f4bcc15f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f4bc4002230 tx=0x7f4bc400a060 comp rx=0 tx=0).stop 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 shutdown_connections 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f4bb806aed0 0x7f4bb806d390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4bcc15e1b0 0x7f4bcc15f710 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.065 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f4bcc0d1b30 0x7f4bcc157d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 --2- 172.21.15.106:0/1771073199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f4bcc15ddd0 0x7f4bcc15a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 >> 172.21.15.106:0/1771073199 conn(0x7f4bcc0731a0 msgr2=0x7f4bcc0aedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 shutdown_connections 2023-11-24T06:15:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.062+0000 7f4bd23c1700 1 -- 172.21.15.106:0/1771073199 wait complete. 2023-11-24T06:15:09.066 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 6 to deep-scrub 2023-11-24T06:15:09.076 INFO:tasks.ceph:Scrubbing osd.7 2023-11-24T06:15:09.077 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-11-24T06:15:09.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.199+0000 7fb4e0a1e700 1 Processor -- start 2023-11-24T06:15:09.202 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.199+0000 7fb4e0a1e700 1 -- start start 2023-11-24T06:15:09.205 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4e0a1e700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fb4dc0b01e0 0x7fb4dc06e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4e0a1e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4dc0b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4e0a1e700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4dc0b05c0 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4e0a1e700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4dc1470a0 con 0x7fb4dc0b01e0 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4e0a1e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0b5e70 con 0x7fb4dc0746a0 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4d9d9b700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb4dc0b59c0 0x7fb4dc073f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40966/0 (socket says 172.21.15.106:40966) 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4d9d9b700 1 -- 172.21.15.106:0/2461303347 learned_addr learned my addr 172.21.15.106:0/2461303347 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:09.206 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4da59c700 1 --2- 172.21.15.106:0/2461303347 >> v2:172.21.15.176:3300/0 conn(0x7fb4dc0b01e0 0x7fb4dc06e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 494128479 0 0) 0x7fb4dc0b05c0 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4dc0b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.200+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4c40035b0 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3580830402 0 0) 0x7fb4c40035b0 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 msgr2=0x7fb4dc0b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4dc0b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 >> v2:172.21.15.176:3300/0 conn(0x7fb4dc0b01e0 msgr2=0x7fb4dc06e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.207 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 --2- 172.21.15.106:0/2461303347 >> v2:172.21.15.176:3300/0 conn(0x7fb4dc0b01e0 0x7fb4dc06e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0b4250 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3704179634 0 0) 0x7fb4cc001670 con 0x7fb4dc0b59c0 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 >> v1:172.21.15.106:6789/0 conn(0x7fb4dc0b59c0 legacy=0x7fb4dc073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4c4003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c4004d90 0x7fb4c4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc1470a0 con 0x7fb4c4003a30 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0b5e70 con 0x7fb4c4004d90 2023-11-24T06:15:09.208 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4c400bae0 con 0x7fb4dc0746a0 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4c4003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c4004d90 0x7fb4c4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d9d9b700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 -- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 msgr2=0x7fb4c4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc0746a0 0x7fb4c4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 -- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c4004d90 msgr2=0x7fb4c4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c4004d90 0x7fb4c4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.209 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 -- 172.21.15.106:0/2461303347 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c40035b0 con 0x7fb4c4003a30 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4c4004d90 0x7fb4c4005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4da59c700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4c4003e50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009b60 tx=0x7fb4c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=956af6ab6d2774e2 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000e6c0 con 0x7fb4c4003a30 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d000e820 con 0x7fb4c4003a30 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.201+0000 7fb4d959a700 1 -- 172.21.15.106:0/2461303347 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000eb90 con 0x7fb4c4003a30 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/2461303347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 msgr2=0x7fb4c4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 --2- 172.21.15.106:0/2461303347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4c4003e50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009b60 tx=0x7fb4c4005880 comp rx=0 tx=0).stop 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4dad9d700 1 -- 172.21.15.106:0/2461303347 reap_dead start 2023-11-24T06:15:09.210 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/2461303347 shutdown_connections 2023-11-24T06:15:09.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/2461303347 >> 172.21.15.106:0/2461303347 conn(0x7fb4dc0d0b40 msgr2=0x7fb4dc0d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/2461303347 shutdown_connections 2023-11-24T06:15:09.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.202+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/2461303347 wait complete. 2023-11-24T06:15:09.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.203+0000 7fb4e0a1e700 1 Processor -- start 2023-11-24T06:15:09.211 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.203+0000 7fb4e0a1e700 1 -- start start 2023-11-24T06:15:09.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4dc0c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4dc138290 0x7fb4dc0c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc138710 0x7fb4dc0c6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.214 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0c7750 con 0x7fb4c4003a30 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0c6b40 con 0x7fb4dc138290 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4e0a1e700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4dc0c6e20 con 0x7fb4dc138710 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4dc0c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4dc0c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60712/0 (socket says 172.21.15.106:60712) 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 -- 172.21.15.106:0/4048318199 learned_addr learned my addr 172.21.15.106:0/4048318199 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4d9d9b700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4dc138290 0x7fb4dc0c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc138710 0x7fb4dc0c6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.215 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 -- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc138710 msgr2=0x7fb4dc0c6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc138710 0x7fb4dc0c6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 -- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4dc138290 msgr2=0x7fb4dc0c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4dc138290 0x7fb4dc0c5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4da59c700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0c7100 con 0x7fb4c4003a30 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fb4dc138710 0x7fb4dc0c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.204+0000 7fb4d9d9b700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fb4dc138290 0x7fb4dc0c5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4da59c700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4dc0c7be0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ba30 tx=0x7fb4d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.216 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d000e6c0 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d0009ed0 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4dc0c73e0 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0003cf0 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.205+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4dc0c8780 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.206+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb4dc06e1c0 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.206+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb4d0013470 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.206+0000 7fb4caffd700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4bc06aed0 0x7fb4bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.206+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb4d008ab90 con 0x7fb4c4003a30 2023-11-24T06:15:09.217 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.206+0000 7fb4d9d9b700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4bc06aed0 0x7fb4bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4caffd700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fb4bc070d30 0x7fb4bc073150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb4bc073820 con 0x7fb4bc070d30 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d008f2c0 con 0x7fb4c4003a30 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4d9d9b700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4bc06aed0 0x7fb4bc06d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc001eb0 tx=0x7fb4cc009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fb4bc070d30 0x7fb4bc073150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.207+0000 7fb4dad9d700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fb4bc070d30 0x7fb4bc073150 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.218 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.208+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== osd.7 v2:172.21.15.176:6800/1585070888 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb4bc073820 con 0x7fb4bc070d30 2023-11-24T06:15:09.225 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.222+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 --> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb4dc06dee0 con 0x7fb4bc070d30 2023-11-24T06:15:09.226 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.223+0000 7fb4caffd700 1 -- 172.21.15.106:0/4048318199 <== osd.7 v2:172.21.15.176:6800/1585070888 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb4d4009850 con 0x7fb4bc070d30 2023-11-24T06:15:09.226 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2023-11-24T06:15:09.226 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-11-24T06:15:09.226 INFO:teuthology.orchestra.run.smithi106.stdout:} 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.223+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fb4bc070d30 msgr2=0x7fb4bc073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.227 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.223+0000 7fb4e0a1e700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.176:6800/1585070888,v1:172.21.15.176:6801/1585070888] conn(0x7fb4bc070d30 0x7fb4bc073150 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.223+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4bc06aed0 msgr2=0x7fb4bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.223+0000 7fb4e0a1e700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fb4bc06aed0 0x7fb4bc06d390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc001eb0 tx=0x7fb4cc009040 comp rx=0 tx=0).stop 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 msgr2=0x7fb4dc0c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 --2- 172.21.15.106:0/4048318199 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb4c4003a30 0x7fb4dc0c7be0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fb4c400ba30 tx=0x7fb4d00047c0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4dad9d700 1 -- 172.21.15.106:0/4048318199 reap_dead start 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 shutdown_connections 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 >> 172.21.15.106:0/4048318199 conn(0x7fb4dc0d0b40 msgr2=0x7fb4dc0b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.228 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 shutdown_connections 2023-11-24T06:15:09.229 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.224+0000 7fb4e0a1e700 1 -- 172.21.15.106:0/4048318199 wait complete. 2023-11-24T06:15:09.238 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-11-24T06:15:09.358 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 Processor -- start 2023-11-24T06:15:09.359 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 -- start start 2023-11-24T06:15:09.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c0d2240 0x7fd18c0b1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd18c15e1b0 0x7fd18c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd18c0b1d40 con 0x7fd18c15ddd0 2023-11-24T06:15:09.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18c0b28c0 con 0x7fd18c15e1b0 2023-11-24T06:15:09.361 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.356+0000 7fd192894700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c06c000 con 0x7fd18c0d2240 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd18c15e1b0 0x7fd18c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18bfff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd18c15ddd0 0x7fd18c0d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40984/0 (socket says 172.21.15.106:40984) 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18bfff700 1 -- 172.21.15.106:0/399124655 learned_addr learned my addr 172.21.15.106:0/399124655 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd18c15e1b0 0x7fd18c0cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60726/0 (socket says 172.21.15.106:60726) 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18b7fe700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c0d2240 0x7fd18c0b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 -- 172.21.15.106:0/399124655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c0d2240 msgr2=0x7fd18c0b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:09.362 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c0d2240 0x7fd18c0b1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 -- 172.21.15.106:0/399124655 >> v1:172.21.15.106:6789/0 conn(0x7fd18c15ddd0 legacy=0x7fd18c0d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 -- 172.21.15.106:0/399124655 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c0b1f90 con 0x7fd18c15e1b0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18affd700 1 -- 172.21.15.106:0/399124655 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752421810 0 0) 0x7fd18c0b1d40 con 0x7fd18c15ddd0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd190e31700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15e1b0 0x7fd18c0cf000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4927911be4b297bb server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18affd700 1 -- 172.21.15.106:0/399124655 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18400e070 con 0x7fd18c15e1b0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18affd700 1 -- 172.21.15.106:0/399124655 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18400bbd0 con 0x7fd18c15e1b0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.357+0000 7fd18affd700 1 -- 172.21.15.106:0/399124655 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd184012430 con 0x7fd18c15e1b0 2023-11-24T06:15:09.363 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 -- 172.21.15.106:0/399124655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15e1b0 msgr2=0x7fd18c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15e1b0 0x7fd18c0cf000 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd184009d90 tx=0x7fd18400b330 comp rx=0 tx=0).stop 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 -- 172.21.15.106:0/399124655 shutdown_connections 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15e1b0 0x7fd18c0cf000 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 --2- 172.21.15.106:0/399124655 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c0d2240 0x7fd18c0b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 -- 172.21.15.106:0/399124655 >> 172.21.15.106:0/399124655 conn(0x7fd18c0731a0 msgr2=0x7fd18c09aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 -- 172.21.15.106:0/399124655 shutdown_connections 2023-11-24T06:15:09.364 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.358+0000 7fd192894700 1 -- 172.21.15.106:0/399124655 wait complete. 2023-11-24T06:15:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.359+0000 7fd192894700 1 Processor -- start 2023-11-24T06:15:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.359+0000 7fd192894700 1 -- start start 2023-11-24T06:15:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 0x7fd18c152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.367 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c15e1b0 0x7fd18c0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b6be0 con 0x7fd18c15ddd0 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c15bba0 con 0x7fd18c0d2240 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd192894700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18c0b5d10 con 0x7fd18c15e1b0 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60728/0 (socket says 172.21.15.106:60728) 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 -- 172.21.15.106:0/4254601608 learned_addr learned my addr 172.21.15.106:0/4254601608 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:09.368 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18bfff700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 0x7fd18c152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd190e31700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c15e1b0 0x7fd18c0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 -- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c15e1b0 msgr2=0x7fd18c0aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c15e1b0 0x7fd18c0aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 -- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 msgr2=0x7fd18c152280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 0x7fd18c152280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 -- 172.21.15.106:0/4254601608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd184009a70 con 0x7fd18c15ddd0 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18bfff700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 0x7fd18c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-24T06:15:09.369 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.360+0000 7fd18b7fe700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c820 tx=0x7fd18000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.361+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011800 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.361+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd180011960 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.361+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18c0b2ed0 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.361+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd180011cf0 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.361+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18c0b62b0 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.362+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18c0b2d30 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.362+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd180018360 con 0x7fd18c15ddd0 2023-11-24T06:15:09.370 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.362+0000 7fd188ff9700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 0x7fd17806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.363+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd180089180 con 0x7fd18c15ddd0 2023-11-24T06:15:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.363+0000 7fd18bfff700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 0x7fd17806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.363+0000 7fd18bfff700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 0x7fd17806d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000f60 tx=0x7fd17c007ca0 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.371 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.367+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd18c0b2d30 con 0x7fd18c15ddd0 2023-11-24T06:15:09.557 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.555+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd18c0b2550 con 0x7fd17806aed0 2023-11-24T06:15:09.558 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.555+0000 7fd188ff9700 1 -- 172.21.15.106:0/4254601608 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd17c005bb0 con 0x7fd17806aed0 2023-11-24T06:15:09.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 msgr2=0x7fd17806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.561 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 0x7fd17806d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd17c000f60 tx=0x7fd17c007ca0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 msgr2=0x7fd18c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fd18000c820 tx=0x7fd18000cbe0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.562 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 shutdown_connections 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fd17806aed0 0x7fd17806d390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fd18c15e1b0 0x7fd18c0aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fd18c0d2240 0x7fd18c152280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 --2- 172.21.15.106:0/4254601608 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd18c15ddd0 0x7fd18c0b57d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 >> 172.21.15.106:0/4254601608 conn(0x7fd18c0731a0 msgr2=0x7fd18c0ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 shutdown_connections 2023-11-24T06:15:09.563 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.557+0000 7fd192894700 1 -- 172.21.15.106:0/4254601608 wait complete. 2023-11-24T06:15:09.564 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 7 to deep-scrub 2023-11-24T06:15:09.572 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:09.692 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.690+0000 7fa5bcbbe700 1 Processor -- start 2023-11-24T06:15:09.693 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.690+0000 7fa5bcbbe700 1 -- start start 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5bcbbe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b815f180 0x7fa5b80cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5bcbbe700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b80b4290 con 0x7fa5b813e000 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5bcbbe700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b813e570 con 0x7fa5b80cfd40 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5bcbbe700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b80d05d0 con 0x7fa5b815f180 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b815f180 0x7fa5b80cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5b815f180 0x7fa5b80cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60738/0 (socket says 172.21.15.106:60738) 2023-11-24T06:15:09.695 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/4013462924 learned_addr learned my addr 172.21.15.106:0/4013462924 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b659c700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa5b813e000 0x7fa5b815ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40998/0 (socket says 172.21.15.106:40998) 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/4013462924 >> v1:172.21.15.176:6789/0 conn(0x7fa5b80cfd40 legacy=0x7fa5b80b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/4013462924 >> v1:172.21.15.106:6789/0 conn(0x7fa5b813e000 legacy=0x7fa5b815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b559a700 1 -- 172.21.15.106:0/4013462924 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431991034 0 0) 0x7fa5b80b4290 con 0x7fa5b813e000 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/4013462924 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b80d08b0 con 0x7fa5b815f180 2023-11-24T06:15:09.696 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b5d9b700 1 --2- 172.21.15.106:0/4013462924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b815f180 0x7fa5b80cf800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098f0 tx=0x7fa5ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37c031a57723a75 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.691+0000 7fa5b559a700 1 -- 172.21.15.106:0/4013462924 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00b8a0 con 0x7fa5b815f180 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5b559a700 1 -- 172.21.15.106:0/4013462924 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac00ba00 con 0x7fa5b815f180 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5b559a700 1 -- 172.21.15.106:0/4013462924 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac00bd90 con 0x7fa5b815f180 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/4013462924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b815f180 msgr2=0x7fa5b80cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/4013462924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b815f180 0x7fa5b80cf800 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0098f0 tx=0x7fa5ac009c00 comp rx=0 tx=0).stop 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/4013462924 shutdown_connections 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/4013462924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b815f180 0x7fa5b80cf800 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.697 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/4013462924 >> 172.21.15.106:0/4013462924 conn(0x7fa5b8072990 msgr2=0x7fa5b806aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/4013462924 shutdown_connections 2023-11-24T06:15:09.698 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.692+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/4013462924 wait complete. 2023-11-24T06:15:09.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 Processor -- start 2023-11-24T06:15:09.700 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 -- start start 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b80cfd40 0x7fa5b81f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5b815f180 0x7fa5b812ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8151e70 con 0x7fa5b813e000 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b81419b0 con 0x7fa5b80cfd40 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5bcbbe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8141c90 con 0x7fa5b815f180 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5b5d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.701 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5b5d9b700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60744/0 (socket says 172.21.15.106:60744) 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.694+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/3307176770 learned_addr learned my addr 172.21.15.106:0/3307176770 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b659c700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b80cfd40 0x7fa5b81f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5b815f180 msgr2=0x7fa5b812ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5b815f180 0x7fa5b812ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b80cfd40 msgr2=0x7fa5b81f0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b80cfd40 0x7fa5b81f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 -- 172.21.15.106:0/3307176770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009550 con 0x7fa5b813e000 2023-11-24T06:15:09.702 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5b5d9b700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac014040 tx=0x7fa5ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0038a0 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5ac003a00 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac003d90 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b8141f70 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.695+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b8142530 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.696+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b8142720 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.696+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa5ac01b5c0 con 0x7fa5b813e000 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.697+0000 7fa5a6ffd700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:09.703 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.697+0000 7fa5b659c700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:09.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.697+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa5ac08c670 con 0x7fa5b813e000 2023-11-24T06:15:09.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.697+0000 7fa5b659c700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 0x7fa59806d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000f60 tx=0x7fa5a8009040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:09.704 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.701+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5ac057ab0 con 0x7fa5b813e000 2023-11-24T06:15:09.835 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:09.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:09.894 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.892+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa5b80b3f20 con 0x7fa59806aed0 2023-11-24T06:15:09.897 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.894+0000 7fa5a6ffd700 1 -- 172.21.15.106:0/3307176770 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50089 (secure 0 0 0) 0x7fa5a80070d0 con 0x7fa59806aed0 2023-11-24T06:15:09.897 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:09.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.896+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 msgr2=0x7fa59806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.899 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.896+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 0x7fa59806d390 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8000f60 tx=0x7fa5a8009040 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.896+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 msgr2=0x7fa5b8143fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.896+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac014040 tx=0x7fa5ac004750 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 shutdown_connections 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fa59806aed0 0x7fa59806d390 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fa5b815f180 0x7fa5b812ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fa5b80cfd40 0x7fa5b81f0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 --2- 172.21.15.106:0/3307176770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5b813e000 0x7fa5b8143fb0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:09.900 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 >> 172.21.15.106:0/3307176770 conn(0x7fa5b8072990 msgr2=0x7fa5b80b08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:09.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 shutdown_connections 2023-11-24T06:15:09.901 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:09.897+0000 7fa5bcbbe700 1 -- 172.21.15.106:0/3307176770 wait complete. 2023-11-24T06:15:09.901 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:15:09.911 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-11-24T06:15:09.705481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220612,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754108,"statfs":{"total":773094113280,"available":772868206592,"internally_reserved":0,"allocated":4530176,"data_stored":2494664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001853"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":179,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-11-24T06:14:57.221254+0000","last_change":"2023-11-24T06:13:29.862047+0000","last_active":"2023-11-24T06:14:57.221254+0000","last_peered":"2023-11-24T06:14:57.221254+0000","last_clean":"2023-11-24T06:14:57.221254+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:14:57.221254+0000","last_undegraded":"2023-11-24T06:14:57.221254+0000","last_fullsized":"2023-11-24T06:14:57.221254+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-24T06:13:28.670453+0000","last_clean_scrub_stamp":"2023-11-24T06:13:28.670453+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T11:08:29.017644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28012,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343828,"statfs":{"total":96636764160,"available":96608079872,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.60799999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.54700000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.627},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.49399999999999999}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.70599999999999996}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.5}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.47499999999999998}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.437}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.309},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.39900000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.32400000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.372}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.33100000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.38600000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.374}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.625},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.57399999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.54500000000000004}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58699999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.379},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.40300000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.503},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.45700000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.58899999999999997}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.60499999999999998}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.56100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27900000000000003},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.32200000000000001}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.29599999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.37},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.312}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":0.502}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.51500000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44900000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.46000000000000002},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.56899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.307},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.33500000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.35699999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39600000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.435}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.46300000000000002}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54600000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59399999999999997}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.63100000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46000000000000002}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.497}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48299999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.432},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65300000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.36399999999999999}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.436},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.52300000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51100000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.621}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:09.915 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-11-24T06:13:28.670453+0000 time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=13, tm_sec=28, tm_wday=4, tm_yday=328, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=11, tm_mday=24, tm_hour=6, tm_min=15, tm_sec=4, tm_wday=4, tm_yday=328, tm_isdst=0) 2023-11-24T06:15:09.915 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-11-24T06:15:29.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-24T06:15:30.057 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.055+0000 7fce4dbfe700 1 Processor -- start 2023-11-24T06:15:30.058 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.055+0000 7fce4dbfe700 1 -- start start 2023-11-24T06:15:30.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce4dbfe700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7fce480d3610 0x7fce480b5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce4dbfe700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce480b5e90 0x7fce480b7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce4dbfe700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce480d2810 con 0x7fce4815e480 2023-11-24T06:15:30.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce4dbfe700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480b62c0 con 0x7fce480b5e90 2023-11-24T06:15:30.060 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce4dbfe700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce480d2a70 con 0x7fce480d3610 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce480b5e90 0x7fce480b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce480b5e90 0x7fce480b7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60754/0 (socket says 172.21.15.106:60754) 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 -- 172.21.15.106:0/3656444780 learned_addr learned my addr 172.21.15.106:0/3656444780 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce46ffd700 1 --2- 172.21.15.106:0/3656444780 >> v2:172.21.15.176:3300/0 conn(0x7fce480d3610 0x7fce480b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 -- 172.21.15.106:0/3656444780 >> v2:172.21.15.176:3300/0 conn(0x7fce480d3610 msgr2=0x7fce480b5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 --2- 172.21.15.106:0/3656444780 >> v2:172.21.15.176:3300/0 conn(0x7fce480d3610 0x7fce480b5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 -- 172.21.15.106:0/3656444780 >> v1:172.21.15.176:6789/0 conn(0x7fce4815e480 legacy=0x7fce480d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.061 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 -- 172.21.15.106:0/3656444780 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce480d2d50 con 0x7fce480b5e90 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce47fff700 1 --2- 172.21.15.106:0/3656444780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480b5e90 0x7fce480b7860 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fce4808c8e0 tx=0x7fce4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e478e3a967750657 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce467fc700 1 -- 172.21.15.106:0/3656444780 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000e070 con 0x7fce480b5e90 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce467fc700 1 -- 172.21.15.106:0/3656444780 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40003a20 con 0x7fce480b5e90 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.056+0000 7fce467fc700 1 -- 172.21.15.106:0/3656444780 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40003dd0 con 0x7fce480b5e90 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3656444780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480b5e90 msgr2=0x7fce480b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.062 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3656444780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480b5e90 0x7fce480b7860 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fce4808c8e0 tx=0x7fce4000b330 comp rx=0 tx=0).stop 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3656444780 shutdown_connections 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3656444780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480b5e90 0x7fce480b7860 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3656444780 >> v2:172.21.15.176:3300/0 conn(0x7fce480d3610 0x7fce480b5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3656444780 >> 172.21.15.106:0/3656444780 conn(0x7fce480d0950 msgr2=0x7fce480d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3656444780 shutdown_connections 2023-11-24T06:15:30.063 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.057+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3656444780 wait complete. 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.059+0000 7fce4dbfe700 1 Processor -- start 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.059+0000 7fce4dbfe700 1 -- start start 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce480b5e90 0x7fce481f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce4815e480 0x7fce480c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480cd9e0 con 0x7fce480d3610 2023-11-24T06:15:30.066 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce481f4a40 con 0x7fce480b5e90 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce4dbfe700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815ed90 con 0x7fce4815e480 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60758/0 (socket says 172.21.15.106:60758) 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 -- 172.21.15.106:0/3369480754 learned_addr learned my addr 172.21.15.106:0/3369480754 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce477fe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce480b5e90 0x7fce481f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce47fff700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce4815e480 0x7fce480c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 -- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce4815e480 msgr2=0x7fce480c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.067 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce4815e480 0x7fce480c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 -- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce480b5e90 msgr2=0x7fce481f4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce480b5e90 0x7fce481f4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 -- 172.21.15.106:0/3369480754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009b30 con 0x7fce480d3610 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.060+0000 7fce46ffd700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fce3800e840 tx=0x7fce3800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.061+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38013610 con 0x7fce480d3610 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.061+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce38013770 con 0x7fce480d3610 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.061+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4815f070 con 0x7fce480d3610 2023-11-24T06:15:30.068 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.061+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38013b20 con 0x7fce480d3610 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.061+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4815f630 con 0x7fce480d3610 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.062+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce480751e0 con 0x7fce480d3610 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.062+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce38013c80 con 0x7fce480d3610 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.063+0000 7fce2ffff700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.063+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce38088de0 con 0x7fce480d3610 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.063+0000 7fce477fe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.069 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.063+0000 7fce477fe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 0x7fce3406d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0012b0 tx=0x7fce3c001240 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.070 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.067+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce380541a0 con 0x7fce480d3610 2023-11-24T06:15:30.255 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.253+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 --> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce480b7340 con 0x7fce3406aed0 2023-11-24T06:15:30.257 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.255+0000 7fce2ffff700 1 -- 172.21.15.106:0/3369480754 <== mgr.4110 v2:172.21.15.106:6832/822714821 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50185 (secure 0 0 0) 0x7fce3c00f610 con 0x7fce3406aed0 2023-11-24T06:15:30.258 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 msgr2=0x7fce3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 0x7fce3406d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0012b0 tx=0x7fce3c001240 comp rx=0 tx=0).stop 2023-11-24T06:15:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 msgr2=0x7fce48160ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fce3800e840 tx=0x7fce3800eb50 comp rx=0 tx=0).stop 2023-11-24T06:15:30.260 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 shutdown_connections 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7fce3406aed0 0x7fce3406d390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7fce4815e480 0x7fce480c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7fce480b5e90 0x7fce481f4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 --2- 172.21.15.106:0/3369480754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce480d3610 0x7fce48160ca0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 >> 172.21.15.106:0/3369480754 conn(0x7fce480d0950 msgr2=0x7fce480d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 shutdown_connections 2023-11-24T06:15:30.261 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.257+0000 7fce4dbfe700 1 -- 172.21.15.106:0/3369480754 wait complete. 2023-11-24T06:15:30.262 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2023-11-24T06:15:30.271 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-11-24T06:15:29.709394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":220600,"kb_used_data":4424,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754120,"statfs":{"total":773094113280,"available":772868218880,"internally_reserved":0,"allocated":4530176,"data_stored":2494664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002324"},"pg_stats":[{"pgid":"1.0","version":"36'119","reported_seq":190,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-11-24T06:15:14.199167+0000","last_change":"2023-11-24T06:15:14.199205+0000","last_active":"2023-11-24T06:15:14.199167+0000","last_peered":"2023-11-24T06:15:14.199167+0000","last_clean":"2023-11-24T06:15:14.199167+0000","last_became_active":"2023-11-24T06:13:29.860969+0000","last_became_peered":"2023-11-24T06:13:29.860969+0000","last_unstale":"2023-11-24T06:15:14.199167+0000","last_undegraded":"2023-11-24T06:15:14.199167+0000","last_fullsized":"2023-11-24T06:15:14.199167+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'119","last_scrub_stamp":"2023-11-24T06:15:14.199058+0000","last_deep_scrub":"36'119","last_deep_scrub_stamp":"2023-11-24T06:15:14.199058+0000","last_clean_scrub_stamp":"2023-11-24T06:15:14.199058+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-11-25T09:45:24.111657+0000","scrub_duration":0.0063613630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":2.8530000000000002,"5min":2.8530000000000002,"15min":2.8530000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":7.4580000000000002,"5min":7.4580000000000002,"15min":7.4580000000000002},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":9.5280000000000005,"5min":9.5280000000000005,"15min":9.5280000000000005},"last":0.63},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":9.5690000000000008,"5min":9.5690000000000008,"15min":9.5690000000000008},"last":0.77800000000000002}]},{"osd":2,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":7.54,"5min":7.54,"15min":7.54},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":18.443000000000001,"5min":18.443000000000001,"15min":18.443000000000001},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":7.5229999999999997,"5min":7.5229999999999997,"15min":7.5229999999999997},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":7.5759999999999996,"5min":7.5759999999999996,"15min":7.5759999999999996},"last":0.67300000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69799999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.749}]},{"osd":6,"last update":"Fri Nov 24 06:14:32 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.79500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.75600000000000001}]},{"osd":2,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64600000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.81899999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.626},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Fri Nov 24 06:14:29 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.71799999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":5.7140000000000004,"5min":5.7140000000000004,"15min":5.7140000000000004},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.29599999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":5.7999999999999998,"5min":5.7999999999999998,"15min":5.7999999999999998},"last":0.375},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":6.452,"5min":6.452,"15min":6.452},"last":0.32500000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":6.4299999999999997,"5min":6.4299999999999997,"15min":6.4299999999999997},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.35799999999999998}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":5.7709999999999999,"5min":5.7709999999999999,"15min":5.7709999999999999},"last":0.54000000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":5.7430000000000003,"5min":5.7430000000000003,"15min":5.7430000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3920000000000003,"5min":6.3920000000000003,"15min":6.3920000000000003},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":5.6719999999999997,"5min":5.6719999999999997,"15min":5.6719999999999997},"last":0.626}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.59899999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343836,"statfs":{"total":96636764160,"available":96608088064,"internally_reserved":0,"allocated":1011712,"data_stored":754609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":15.051,"5min":15.051,"15min":15.051},"last":0.313},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":21.533000000000001,"5min":21.533000000000001,"15min":21.533000000000001},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.135,"15min":1.135},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":15.019,"5min":15.019,"15min":15.019},"last":0.497},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":21.507999999999999,"5min":21.507999999999999,"15min":21.507999999999999},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":8.3049999999999997,"5min":8.3049999999999997,"15min":8.3049999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":15.128,"5min":15.128,"15min":15.128},"last":0.35999999999999999}]},{"osd":4,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.359,"5min":1.359,"15min":1.359},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":14.939,"5min":14.939,"15min":14.939},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.712,"15min":1.712},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":21.446000000000002,"5min":21.446000000000002,"15min":21.446000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.44600000000000001}]},{"osd":6,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":14.989000000000001,"5min":14.989000000000001,"15min":14.989000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":1.714,"5min":1.714,"15min":1.714},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":21.481000000000002,"5min":21.481000000000002,"15min":21.481000000000002},"last":0.52800000000000002}]},{"osd":7,"last update":"Fri Nov 24 06:14:27 2023","interfaces":[{"interface":"back","average":{"1min":1.706,"5min":1.706,"15min":1.706},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":21.381,"5min":21.381,"15min":21.381},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":0.51500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.38400000000000001},{"interface":"front","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":14.141,"5min":14.141,"15min":14.141},"last":0.47799999999999998}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":11.052,"5min":11.052,"15min":11.052},"last":0.501}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":14.170999999999999,"5min":14.170999999999999,"15min":14.170999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.46000000000000002}]},{"osd":4,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":6.048,"5min":6.048,"15min":6.048},"last":0.65600000000000003},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":11.018000000000001,"5min":11.018000000000001,"15min":11.018000000000001},"last":1.198}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":10.960000000000001,"5min":10.960000000000001,"15min":10.960000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":14.087,"5min":14.087,"15min":14.087},"last":0.68200000000000005}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":14.113,"5min":14.113,"15min":14.113},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61799999999999999}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.198,"15min":1.198},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":10.992000000000001,"5min":10.992000000000001,"15min":10.992000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":14.050000000000001,"5min":14.050000000000001,"15min":14.050000000000001},"last":0.63300000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.374,"5min":0.374,"15min":0.374},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.40000000000000002}]},{"osd":1,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":6.3330000000000002,"5min":6.3330000000000002,"15min":6.3330000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":10.970000000000001,"5min":10.970000000000001,"15min":10.970000000000001},"last":0.35299999999999998}]},{"osd":2,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":6.4630000000000001,"5min":6.4630000000000001,"15min":6.4630000000000001},"last":0.378},{"interface":"front","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.441}]},{"osd":4,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4080000000000004,"5min":6.4080000000000004,"15min":6.4080000000000004},"last":0.57099999999999995}]},{"osd":5,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":6.3710000000000004,"5min":6.3710000000000004,"15min":6.3710000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":6.4340000000000002,"5min":6.4340000000000002,"15min":6.4340000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Fri Nov 24 06:14:28 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.47999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58299999999999996}]},{"osd":2,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63400000000000001}]},{"osd":3,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46999999999999997}]},{"osd":6,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Nov 24 06:14:31 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49199999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27432,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":417792,"data_stored":164241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.81200000000000006}]},{"osd":1,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.68600000000000005}]},{"osd":2,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.62}]},{"osd":3,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.79100000000000004}]},{"osd":4,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.498},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.57599999999999996}]},{"osd":7,"last update":"Fri Nov 24 06:14:30 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.63600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-24T06:15:30.273 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-11-24T06:15:30.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.391+0000 7f8556a99700 1 Processor -- start 2023-11-24T06:15:30.394 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.391+0000 7f8556a99700 1 -- start start 2023-11-24T06:15:30.396 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8556a99700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85501587f0 0x7f855006aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8556a99700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85500b4370 0x7f855015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8556a99700 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f855006b530 con 0x7f855015b370 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8556a99700 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85500ae5e0 con 0x7f85500b4370 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8556a99700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855015be30 con 0x7f85501587f0 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f8555036700 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85500b4370 0x7f855015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f854ffff700 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f855015b370 0x7f85500b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41026/0 (socket says 172.21.15.106:41026) 2023-11-24T06:15:30.397 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.392+0000 7f854ffff700 1 -- 172.21.15.106:0/206353097 learned_addr learned my addr 172.21.15.106:0/206353097 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8554835700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85501587f0 0x7f855006aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8555036700 1 -- 172.21.15.106:0/206353097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85501587f0 msgr2=0x7f855006aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8555036700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85501587f0 0x7f855006aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8555036700 1 -- 172.21.15.106:0/206353097 >> v1:172.21.15.106:6789/0 conn(0x7f855015b370 legacy=0x7f85500b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8555036700 1 -- 172.21.15.106:0/206353097 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f855015c110 con 0x7f85500b4370 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f854f7fe700 1 -- 172.21.15.106:0/206353097 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783163199 0 0) 0x7f855006b530 con 0x7f855015b370 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8555036700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85500b4370 0x7f855015b7f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8548009d90 tx=0x7f854800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d5d3fb5b4c7571 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.398 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f854f7fe700 1 -- 172.21.15.106:0/206353097 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854800e070 con 0x7f85500b4370 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f854f7fe700 1 -- 172.21.15.106:0/206353097 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854800bbd0 con 0x7f85500b4370 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f854f7fe700 1 -- 172.21.15.106:0/206353097 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548012430 con 0x7f85500b4370 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8556a99700 1 -- 172.21.15.106:0/206353097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85500b4370 msgr2=0x7f855015b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8556a99700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85500b4370 0x7f855015b7f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f8548009d90 tx=0x7f854800b330 comp rx=0 tx=0).stop 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.393+0000 7f8556a99700 1 -- 172.21.15.106:0/206353097 shutdown_connections 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.394+0000 7f8556a99700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85500b4370 0x7f855015b7f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.394+0000 7f8556a99700 1 --2- 172.21.15.106:0/206353097 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85501587f0 0x7f855006aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.399 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.394+0000 7f8556a99700 1 -- 172.21.15.106:0/206353097 >> 172.21.15.106:0/206353097 conn(0x7f85500d0bf0 msgr2=0x7f85500d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.394+0000 7f8556a99700 1 -- 172.21.15.106:0/206353097 shutdown_connections 2023-11-24T06:15:30.400 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.394+0000 7f8556a99700 1 -- 172.21.15.106:0/206353097 wait complete. 2023-11-24T06:15:30.403 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.395+0000 7f8556a99700 1 Processor -- start 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.395+0000 7f8556a99700 1 -- start start 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 0x7f855014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 0x7f8550073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855009d6d0 con 0x7f85501587f0 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f855009d9b0 con 0x7f855015b370 2023-11-24T06:15:30.404 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f855009dc90 con 0x7f85500b4370 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60770/0 (socket says 172.21.15.106:60770) 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 -- 172.21.15.106:0/1342671743 learned_addr learned my addr 172.21.15.106:0/1342671743 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8554835700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 0x7f855014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8555036700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 0x7f8550073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 -- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 msgr2=0x7f855014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.405 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 0x7f855014d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 -- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 msgr2=0x7f8550073f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 0x7f8550073f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 -- 172.21.15.106:0/1342671743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8548009a70 con 0x7f85501587f0 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8555036700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 0x7f8550073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8554835700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 0x7f855014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854ffff700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c550 tx=0x7f853c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.406 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c004c80 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c004e00 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f855009df70 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c007310 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.396+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855009e770 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.397+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8550068fb0 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.398+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f853c007470 con 0x7f85501587f0 2023-11-24T06:15:30.407 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.398+0000 7f854d7fa700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 0x7f853406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.398+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f853c088f40 con 0x7f85501587f0 2023-11-24T06:15:30.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.398+0000 7f8554835700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 0x7f853406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.399+0000 7f8554835700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 0x7f853406d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8544009a00 tx=0x7f8544008040 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.408 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.403+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f853c054380 con 0x7f85501587f0 2023-11-24T06:15:30.597 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.594+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f85500d0340 con 0x7f85501587f0 2023-11-24T06:15:30.600 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.598+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f853c0579a0 con 0x7f85501587f0 2023-11-24T06:15:30.602 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.600+0000 7f854d7fa700 1 -- 172.21.15.106:0/1342671743 <== mon.0 v2:172.21.15.106:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f853c0011d0 con 0x7f85501587f0 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 msgr2=0x7f853406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 0x7f853406d390 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f8544009a00 tx=0x7f8544008040 comp rx=0 tx=0).stop 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 msgr2=0x7f855009cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f853c00c550 tx=0x7f853c00c910 comp rx=0 tx=0).stop 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 shutdown_connections 2023-11-24T06:15:30.604 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7f853406aed0 0x7f853406d390 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7f855015b370 0x7f8550073f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7f85500b4370 0x7f855014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 --2- 172.21.15.106:0/1342671743 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85501587f0 0x7f855009cc10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 >> 172.21.15.106:0/1342671743 conn(0x7f85500d0bf0 msgr2=0x7f855006ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 shutdown_connections 2023-11-24T06:15:30.605 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.601+0000 7f8556a99700 1 -- 172.21.15.106:0/1342671743 wait complete. 2023-11-24T06:15:30.616 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-24T06:15:30.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-24T06:15:30.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.734+0000 7ff3e1548700 1 Processor -- start 2023-11-24T06:15:30.737 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.734+0000 7ff3e1548700 1 -- start start 2023-11-24T06:15:30.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3e1548700 1 --2- >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15e1e0 0x7ff3dc0d34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.739 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3e1548700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 0x7ff3dc0d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3e1548700 1 -- --> v1:172.21.15.176:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc0d20b0 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3e1548700 1 -- --> v2:172.21.15.176:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d3150 con 0x7ff3dc15e1e0 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3e1548700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0d1240 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3db7fe700 1 --1- >> v1:172.21.15.176:6789/0 conn(0x7ff3dc0d0db0 0x7ff3dc06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.176:6789/0 says I am v1:172.21.15.106:35286/0 (socket says 172.21.15.106:35286) 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3da7fc700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 0x7ff3dc0d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.735+0000 7ff3db7fe700 1 -- 172.21.15.106:0/920215296 learned_addr learned my addr 172.21.15.106:0/920215296 (peer_addr_for_me v1:172.21.15.106:0/0) 2023-11-24T06:15:30.740 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3daffd700 1 --2- 172.21.15.106:0/920215296 >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15e1e0 0x7ff3dc0d34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3d9ffb700 1 -- 172.21.15.106:0/920215296 <== mon.1 v1:172.21.15.176:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743122173 0 0) 0x7ff3dc0d20b0 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3d9ffb700 1 -- 172.21.15.106:0/920215296 --> v1:172.21.15.176:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3c40035b0 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3da7fc700 1 -- 172.21.15.106:0/920215296 >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15e1e0 msgr2=0x7ff3dc0d34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3da7fc700 1 --2- 172.21.15.106:0/920215296 >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15e1e0 0x7ff3dc0d34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3da7fc700 1 -- 172.21.15.106:0/920215296 >> v1:172.21.15.176:6789/0 conn(0x7ff3dc0d0db0 legacy=0x7ff3dc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3da7fc700 1 -- 172.21.15.106:0/920215296 --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc0d2390 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3da7fc700 1 --2- 172.21.15.106:0/920215296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 0x7ff3dc0d0870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009840 tx=0x7ff3cc009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc4c79ea3098721 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.741 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3d9ffb700 1 -- 172.21.15.106:0/920215296 <== mon.2 v2:172.21.15.176:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc011830 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3d9ffb700 1 -- 172.21.15.106:0/920215296 <== mon.2 v2:172.21.15.176:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3cc011990 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.736+0000 7ff3d9ffb700 1 -- 172.21.15.106:0/920215296 <== mon.2 v2:172.21.15.176:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc011d40 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 -- 172.21.15.106:0/920215296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 msgr2=0x7ff3dc0d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 --2- 172.21.15.106:0/920215296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 0x7ff3dc0d0870 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc009840 tx=0x7ff3cc009b50 comp rx=0 tx=0).stop 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 -- 172.21.15.106:0/920215296 shutdown_connections 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 --2- 172.21.15.106:0/920215296 >> v2:172.21.15.176:3300/0 conn(0x7ff3dc15e1e0 0x7ff3dc0d34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 --2- 172.21.15.106:0/920215296 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc0d3a00 0x7ff3dc0d0870 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.742 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 -- 172.21.15.106:0/920215296 >> 172.21.15.106:0/920215296 conn(0x7ff3dc0b5b50 msgr2=0x7ff3dc0b5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 -- 172.21.15.106:0/920215296 shutdown_connections 2023-11-24T06:15:30.743 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.737+0000 7ff3e1548700 1 -- 172.21.15.106:0/920215296 wait complete. 2023-11-24T06:15:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.738+0000 7ff3e1548700 1 Processor -- start 2023-11-24T06:15:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.738+0000 7ff3e1548700 1 -- start start 2023-11-24T06:15:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.745 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 --2- >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0d3a00 0x7ff3dc1540d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 --2- >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15e1e0 0x7ff3dc1f7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc156c50 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 -- --> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc156f30 con 0x7ff3dc0d3a00 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3e1548700 1 -- --> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc15f830 con 0x7ff3dc15e1e0 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:60786/0 (socket says 172.21.15.106:60786) 2023-11-24T06:15:30.746 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 -- 172.21.15.106:0/1431995036 learned_addr learned my addr 172.21.15.106:0/1431995036 (peer_addr_for_me v2:172.21.15.106:0/0) 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3db7fe700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15e1e0 0x7ff3dc1f7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3da7fc700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0d3a00 0x7ff3dc1540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 -- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15e1e0 msgr2=0x7ff3dc1f7160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15e1e0 0x7ff3dc1f7160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 -- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0d3a00 msgr2=0x7ff3dc1540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0d3a00 0x7ff3dc1540d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.747 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.739+0000 7ff3daffd700 1 -- 172.21.15.106:0/1431995036 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0094a0 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3daffd700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000d800 tx=0x7ff3d000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d00125f0 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff3d0012750 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc15fb10 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d0012b20 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.740+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc154610 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.741+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc160160 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.748 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.741+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3d0012c80 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.741+0000 7ff3c37fe700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 0x7ff3c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-24T06:15:30.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.741+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff3d0089340 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.742+0000 7ff3da7fc700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 0x7ff3c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-24T06:15:30.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.742+0000 7ff3da7fc700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 0x7ff3c806d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc008030 comp rx=0 tx=0).ready entity=mgr.4110 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-24T06:15:30.749 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.746+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3d0054660 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.979+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3dc069050 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.982 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.980+0000 7ff3c37fe700 1 -- 172.21.15.106:0/1431995036 <== mon.0 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3711 (secure 0 0 0) 0x7ff3d0057c80 con 0x7ff3dc0d0db0 2023-11-24T06:15:30.983 INFO:teuthology.orchestra.run.smithi106.stdout: 2023-11-24T06:15:30.983 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5041,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6835/4199083397","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6833","nonce":4199083397},{"type":"v1","addr":"172.21.15.176:6835","nonce":4199083397}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20},{"gid":5076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3459689059","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3459689059},{"type":"v1","addr":"172.21.15.106:6836","nonce":3459689059}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5079,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4003899209","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4003899209},{"type":"v1","addr":"172.21.15.106:6837","nonce":4003899209}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5085,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.176:6834/2378289221","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.176:6832","nonce":2378289221},{"type":"v1","addr":"172.21.15.176:6834","nonce":2378289221}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[]} 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 msgr2=0x7ff3c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 0x7ff3c806d3c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc000c00 tx=0x7ff3cc008030 comp rx=0 tx=0).stop 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 msgr2=0x7ff3dc156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff3d000d800 tx=0x7ff3d000db10 comp rx=0 tx=0).stop 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 shutdown_connections 2023-11-24T06:15:30.985 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:6832/822714821,v1:172.21.15.106:6833/822714821] conn(0x7ff3c806af00 0x7ff3c806d3c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3301/0,v1:172.21.15.176:6790/0] conn(0x7ff3dc15e1e0 0x7ff3dc1f7160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff3dc0d0db0 0x7ff3dc156570 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 --2- 172.21.15.106:0/1431995036 >> [v2:172.21.15.176:3300/0,v1:172.21.15.176:6789/0] conn(0x7ff3dc0d3a00 0x7ff3dc1540d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 >> 172.21.15.106:0/1431995036 conn(0x7ff3dc0b5b50 msgr2=0x7ff3dc0b83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 shutdown_connections 2023-11-24T06:15:30.986 INFO:teuthology.orchestra.run.smithi106.stderr:2023-11-24T06:15:30.982+0000 7ff3e1548700 1 -- 172.21.15.106:0/1431995036 wait complete. 2023-11-24T06:15:30.987 INFO:teuthology.orchestra.run.smithi106.stderr:dumped fsmap epoch 20 2023-11-24T06:15:30.996 DEBUG:tasks.cephfs.filesystem:already dead... 2023-11-24T06:15:30.997 INFO:teuthology.misc:Shutting down mds daemons... 2023-11-24T06:15:30.997 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-24T06:15:30.997 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.006 INFO:tasks.ceph.mds.a:Stopped 2023-11-24T06:15:31.006 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-24T06:15:31.006 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.055 INFO:tasks.ceph.mds.c:Stopped 2023-11-24T06:15:31.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-24T06:15:31.055 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.066 INFO:tasks.ceph.mds.b:Stopped 2023-11-24T06:15:31.066 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-11-24T06:15:31.067 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.117 INFO:tasks.ceph.mds.d:Stopped 2023-11-24T06:15:31.117 INFO:teuthology.misc:Shutting down osd daemons... 2023-11-24T06:15:31.118 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-11-24T06:15:31.118 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.159 INFO:tasks.ceph.osd.0:Stopped 2023-11-24T06:15:31.159 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-11-24T06:15:31.159 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.199 INFO:tasks.ceph.osd.1:Stopped 2023-11-24T06:15:31.200 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-11-24T06:15:31.200 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.271 INFO:tasks.ceph.osd.2:Stopped 2023-11-24T06:15:31.272 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-11-24T06:15:31.272 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.347 INFO:tasks.ceph.osd.3:Stopped 2023-11-24T06:15:31.347 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-11-24T06:15:31.347 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.397 INFO:tasks.ceph.osd.4:Stopped 2023-11-24T06:15:31.398 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-11-24T06:15:31.398 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.436 INFO:tasks.ceph.osd.5:Stopped 2023-11-24T06:15:31.436 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-11-24T06:15:31.437 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.512 INFO:tasks.ceph.osd.6:Stopped 2023-11-24T06:15:31.513 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-11-24T06:15:31.513 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.592 INFO:tasks.ceph.osd.7:Stopped 2023-11-24T06:15:31.592 INFO:teuthology.misc:Shutting down mgr daemons... 2023-11-24T06:15:31.593 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-11-24T06:15:31.593 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.616 INFO:tasks.ceph.mgr.y:Stopped 2023-11-24T06:15:31.616 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-11-24T06:15:31.616 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.657 INFO:tasks.ceph.mgr.x:Stopped 2023-11-24T06:15:31.657 INFO:teuthology.misc:Shutting down mon daemons... 2023-11-24T06:15:31.658 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-11-24T06:15:31.658 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.668 INFO:tasks.ceph.mon.a:Stopped 2023-11-24T06:15:31.668 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-11-24T06:15:31.668 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.709 INFO:tasks.ceph.mon.b:Stopped 2023-11-24T06:15:31.709 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-11-24T06:15:31.709 INFO:teuthology.orchestra.run:waiting for 300 2023-11-24T06:15:31.761 INFO:tasks.ceph.mon.c:Stopped 2023-11-24T06:15:31.761 INFO:tasks.ceph:Checking cluster log for badness... 2023-11-24T06:15:31.761 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-11-24T06:15:31.797 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:15:31.797 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-11-24T06:15:32.019 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:15:32.019 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-11-24T06:15:32.097 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:15:32.098 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-11-24T06:15:32.175 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:15:32.175 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-11-24T06:15:32.266 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:15:32.266 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-11-24T06:15:32.431 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:15:32.431 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-11-24T06:15:32.583 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:15:32.583 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-11-24T06:15:32.682 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:15:32.683 DEBUG:teuthology.orchestra.run.smithi176:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-11-24T06:15:32.777 INFO:tasks.ceph:Archiving mon data... 2023-11-24T06:15:32.778 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/data/mon.a.tgz 2023-11-24T06:15:32.778 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2023-11-24T06:15:32.797 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.fXDy3EBzg4 2023-11-24T06:15:32.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fXDy3EBzg4 2023-11-24T06:15:32.917 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.fXDy3EBzg4 2023-11-24T06:15:33.003 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.fXDy3EBzg4 is 276KB 2023-11-24T06:15:33.097 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.fXDy3EBzg4 2023-11-24T06:15:33.114 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/data/mon.b.tgz 2023-11-24T06:15:33.114 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-11-24T06:15:33.133 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.2Xc2aM3vVW 2023-11-24T06:15:33.133 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.2Xc2aM3vVW 2023-11-24T06:15:33.289 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.2Xc2aM3vVW 2023-11-24T06:15:33.376 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.2Xc2aM3vVW is 372KB 2023-11-24T06:15:33.473 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.2Xc2aM3vVW 2023-11-24T06:15:33.489 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/data/mon.c.tgz 2023-11-24T06:15:33.489 DEBUG:teuthology.orchestra.run.smithi176:> mktemp 2023-11-24T06:15:33.545 INFO:teuthology.orchestra.run.smithi176.stdout:/tmp/tmp.n6Co7LtpH3 2023-11-24T06:15:33.545 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.n6Co7LtpH3 2023-11-24T06:15:33.675 DEBUG:teuthology.orchestra.run.smithi176:> sudo chmod 0666 /tmp/tmp.n6Co7LtpH3 2023-11-24T06:15:33.760 DEBUG:teuthology.orchestra.remote:smithi176:/tmp/tmp.n6Co7LtpH3 is 372KB 2023-11-24T06:15:33.855 DEBUG:teuthology.orchestra.run.smithi176:> rm -fr /tmp/tmp.n6Co7LtpH3 2023-11-24T06:15:33.871 INFO:tasks.ceph:Cleaning ceph cluster... 2023-11-24T06:15:33.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:15:33.874 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-11-24T06:15:33.938 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-11-24T06:15:33.938 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:15:33.943 DEBUG:teuthology.orchestra.run.smithi176:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-11-24T06:15:33.983 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:15:34.011 INFO:teuthology.orchestra.run.smithi176.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-11-24T06:15:34.016 INFO:tasks.ceph:Archiving crash dumps... 2023-11-24T06:15:34.018 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi106/crash 2023-11-24T06:15:34.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:15:34.056 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi176/crash 2023-11-24T06:15:34.057 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-11-24T06:15:34.083 INFO:tasks.ceph:Shutting down logrotate 2023-11-24T06:15:34.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:34.100 DEBUG:teuthology.orchestra.run.smithi176:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:34.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:34.194 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-11-24T06:15:34.234 INFO:tasks.ceph:Compressing logs... 2023-11-24T06:15:34.235 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:15:34.237 DEBUG:teuthology.orchestra.run.smithi176:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-11-24T06:15:34.323 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-11-24T06:15:34.323 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111655.log 2023-11-24T06:15:34.323 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110860.log 2023-11-24T06:15:34.324 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.1.111655.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:15:34.324 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111655.log.gz 2023-11-24T06:15:34.324 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.3.110860.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.3.110860.log.gz--verbose 2023-11-24T06:15:34.324 INFO:teuthology.orchestra.run.smithi176.stderr:-- /var/log/ceph/ceph-client.1.111659.log 2023-11-24T06:15:34.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103618.log 2023-11-24T06:15:34.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.111659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103481.log 2023-11-24T06:15:34.325 INFO:teuthology.orchestra.run.smithi176.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.111659.log.gz 2023-11-24T06:15:34.325 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103618.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-11-24T06:15:34.325 INFO:teuthology.orchestra.run.smithi176.stderr: 91.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:15:34.326 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103481.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103618.log.gz 2023-11-24T06:15:34.326 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103435.log 2023-11-24T06:15:34.326 INFO:teuthology.orchestra.run.smithi176.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103481.log.gz 2023-11-24T06:15:34.326 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103664.log 2023-11-24T06:15:34.327 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110249.log 2023-11-24T06:15:34.327 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103664.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103435.log.gz 2023-11-24T06:15:34.327 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103526.log 2023-11-24T06:15:34.327 INFO:teuthology.orchestra.run.smithi176.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103664.log.gz 2023-11-24T06:15:34.327 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.110249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110249.log.gz 2023-11-24T06:15:34.328 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-11-24T06:15:34.328 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:15:34.328 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103526.log: /var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-11-24T06:15:34.328 INFO:teuthology.orchestra.run.smithi176.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.103526.log.gz 2023-11-24T06:15:34.329 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-11-24T06:15:34.329 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-11-24T06:15:34.329 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:15:34.329 INFO:teuthology.orchestra.run.smithi176.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-11-24T06:15:34.329 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103573.log 2023-11-24T06:15:34.330 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103710.log 2023-11-24T06:15:34.330 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103573.log: 88.0%/var/log/ceph/ceph-client.admin.103710.log: -- replaced with /var/log/ceph/ceph-client.admin.103573.log.gz 2023-11-24T06:15:34.330 INFO:teuthology.orchestra.run.smithi176.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103710.log.gz 2023-11-24T06:15:34.330 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-11-24T06:15:34.331 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110856.log 2023-11-24T06:15:34.331 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-client.3.110856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.110856.log.gz 2023-11-24T06:15:34.331 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-11-24T06:15:34.332 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-11-24T06:15:34.333 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103761.log 2023-11-24T06:15:34.340 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.admin.103761.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.103761.log.gz 2023-11-24T06:15:34.340 INFO:teuthology.orchestra.run.smithi176.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.110241.log 2023-11-24T06:15:34.352 INFO:teuthology.orchestra.run.smithi176.stderr:/var/log/ceph/ceph-client.1.110241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.110241.log.gz 2023-11-24T06:15:34.353 INFO:teuthology.orchestra.run.smithi176.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-11-24T06:15:34.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110913.log 2023-11-24T06:15:34.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110911.log 2023-11-24T06:15:34.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip /var/log/ceph/ceph-client.admin.110913.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.109790.log 2023-11-24T06:15:34.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110911.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110913.log.gz 2023-11-24T06:15:34.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118591.log 2023-11-24T06:15:34.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111285.log 2023-11-24T06:15:34.357 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.110911.log.gz 2023-11-24T06:15:34.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118591.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109790.log.gz 2023-11-24T06:15:34.358 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115657.log 2023-11-24T06:15:34.358 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2%/var/log/ceph/ceph-client.admin.111285.log: -- replaced with /var/log/ceph/ceph-client.admin.118591.log.gz 2023-11-24T06:15:34.358 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110550.log 2023-11-24T06:15:34.358 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111285.log.gz 2023-11-24T06:15:34.359 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115186.log 2023-11-24T06:15:34.359 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115657.log: /var/log/ceph/ceph-client.admin.110550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111586.log 2023-11-24T06:15:34.359 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115657.log.gz 2023-11-24T06:15:34.359 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115186.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110550.log.gz 2023-11-24T06:15:34.359 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120997.log 2023-11-24T06:15:34.360 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111586.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.115186.log.gz 2023-11-24T06:15:34.360 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110298.log 2023-11-24T06:15:34.360 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120997.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.111586.log.gz 2023-11-24T06:15:34.360 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116297.log 2023-11-24T06:15:34.361 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120997.log.gz 2023-11-24T06:15:34.361 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117171.log 2023-11-24T06:15:34.361 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116297.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.110298.log.gz 2023-11-24T06:15:34.361 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116793.log 2023-11-24T06:15:34.361 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117171.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.116297.log.gz 2023-11-24T06:15:34.362 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119250.log 2023-11-24T06:15:34.362 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117171.log.gz 2023-11-24T06:15:34.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116793.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-11-24T06:15:34.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119250.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116793.log.gz 2023-11-24T06:15:34.363 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115052.log 2023-11-24T06:15:34.363 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119250.log.gz 2023-11-24T06:15:34.363 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120583.log 2023-11-24T06:15:34.363 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114029.log 2023-11-24T06:15:34.363 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120583.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115052.log.gz 2023-11-24T06:15:34.364 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113937.log 2023-11-24T06:15:34.364 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120583.log.gz 2023-11-24T06:15:34.364 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103281.log 2023-11-24T06:15:34.364 INFO:teuthology.orchestra.run.smithi106.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114029.log.gz 2023-11-24T06:15:34.364 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110548.log 2023-11-24T06:15:34.365 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.113937.log.gz 2023-11-24T06:15:34.365 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.103281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117610.log 2023-11-24T06:15:34.365 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116933.log 2023-11-24T06:15:34.365 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.103281.log.gz 2023-11-24T06:15:34.365 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110548.log.gz 2023-11-24T06:15:34.366 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116481.log 2023-11-24T06:15:34.366 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113845.log 2023-11-24T06:15:34.366 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117610.log.gz 2023-11-24T06:15:34.366 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116481.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.116933.log.gz 2023-11-24T06:15:34.367 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115519.log 2023-11-24T06:15:34.367 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116481.log.gz 2023-11-24T06:15:34.367 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121249.log 2023-11-24T06:15:34.367 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115519.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.113845.log.gz 2023-11-24T06:15:34.368 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-11-24T06:15:34.368 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121249.log: gzip -5 88.9%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.115519.log.gz/var/log/ceph/ceph-client.admin.115370.log 2023-11-24T06:15:34.368 INFO:teuthology.orchestra.run.smithi106.stderr: 2023-11-24T06:15:34.368 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.121249.log.gz--verbose 2023-11-24T06:15:34.369 INFO:teuthology.orchestra.run.smithi106.stderr:-- /var/log/ceph/ceph-client.admin.110915.log 2023-11-24T06:15:34.369 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119572.log 2023-11-24T06:15:34.369 INFO:teuthology.orchestra.run.smithi106.stderr: 84.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-11-24T06:15:34.369 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115370.log.gz 2023-11-24T06:15:34.370 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109675.log 2023-11-24T06:15:34.370 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119572.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.110915.log.gz 2023-11-24T06:15:34.370 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119158.log 2023-11-24T06:15:34.370 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109444.log 88.9% 2023-11-24T06:15:34.371 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.119572.log.gz 2023-11-24T06:15:34.371 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109675.log.gz 2023-11-24T06:15:34.371 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116573.log 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109444.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.119158.log.gz 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120537.log 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116573.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109444.log.gz 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109490.log 2023-11-24T06:15:34.372 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116573.log.gz 2023-11-24T06:15:34.373 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117071.log 2023-11-24T06:15:34.373 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112338.log 89.0% 2023-11-24T06:15:34.373 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.120537.log.gz 2023-11-24T06:15:34.373 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117071.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.109490.log.gz 2023-11-24T06:15:34.373 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117794.log 2023-11-24T06:15:34.374 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.117071.log.gz 2023-11-24T06:15:34.374 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.112338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117313.log 2023-11-24T06:15:34.374 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117794.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.112338.log.gz 2023-11-24T06:15:34.374 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110918.log 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117794.log.gz 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111724.log /var/log/ceph/ceph-client.admin.117313.log: 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114260.log 2023-11-24T06:15:34.375 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.117313.log.gz 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110918.log.gz 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111126.log 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114511.log 2023-11-24T06:15:34.376 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114260.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111724.log.gz 2023-11-24T06:15:34.377 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121295.log 2023-11-24T06:15:34.377 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111126.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114260.log.gz 2023-11-24T06:15:34.377 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117840.log 2023-11-24T06:15:34.377 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.111126.log.gz 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121295.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114511.log.gz 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112138.log 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117840.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121295.log.gz 2023-11-24T06:15:34.378 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110022.log 2023-11-24T06:15:34.379 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.112138.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-11-24T06:15:34.380 INFO:teuthology.orchestra.run.smithi106.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.117840.log.gz 2023-11-24T06:15:34.380 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110022.log: gzip 88.6%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.112138.log.gz-- 2023-11-24T06:15:34.381 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111678.log 2023-11-24T06:15:34.381 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110022.log.gz 2023-11-24T06:15:34.381 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109146.log 2023-11-24T06:15:34.381 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110114.log 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111678.log.gz 2023-11-24T06:15:34.382 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118863.log 2023-11-24T06:15:34.383 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110114.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109146.log.gz 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109629.log 2023-11-24T06:15:34.384 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110114.log.gz 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112092.log 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118955.log 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109629.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.118863.log.gz 2023-11-24T06:15:34.385 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.112092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111286.log 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.109629.log.gz 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.112092.log.gz 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117359.log 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118345.log 2023-11-24T06:15:34.386 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118955.log.gz 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117359.log: gzip 88.2%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.111286.log.gz/var/log/ceph/ceph-mds.a.log 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi106.stderr: 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118345.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117359.log.gz 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118391.log 2023-11-24T06:15:34.387 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118345.log.gz 2023-11-24T06:15:34.388 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112184.log 2023-11-24T06:15:34.388 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.118391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115837.log 2023-11-24T06:15:34.388 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.112184.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118391.log.gz 2023-11-24T06:15:34.388 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111278.log 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115837.log: 91.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gzgzip 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.110534.log 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111278.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.115837.log.gz 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.112184.log.gz 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110534.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.111278.log.gz 2023-11-24T06:15:34.389 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.110534.log.gz 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120859.log 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109884.log 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113485.log 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119204.log 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120859.log.gz 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109884.log.gz 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.2.113485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113485.log.gz 2023-11-24T06:15:34.390 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114168.log 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121135.log 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119204.log: /var/log/ceph/ceph-client.admin.114168.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119204.log.gz 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121135.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.114168.log.gz 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115232.log 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96997.log 2023-11-24T06:15:34.391 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.3.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121135.log.gz 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115006.log 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115232.log.gz 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.tmp-client.admin.96997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114914.log 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96997.log.gz 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116021.log 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115006.log: /var/log/ceph/ceph-client.admin.114914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110068.log 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.115006.log.gz 2023-11-24T06:15:34.392 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.114914.log.gz 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115473.log 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116021.log.gz 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116205.log 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115473.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.110068.log.gz 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116205.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.115473.log.gz 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116205.log.gz 2023-11-24T06:15:34.393 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119802.log 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114741.log 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119710.log 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.119802.log.gz 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115611.log 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119710.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.114741.log.gz 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115611.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.119710.log.gz 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119756.log 2023-11-24T06:15:34.394 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.115611.log.gz 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111632.log 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115745.log 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111632.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.119756.log.gz 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115745.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.111632.log.gz 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.115745.log.gz 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120215.log 2023-11-24T06:15:34.395 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113799.log 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113707.log 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120215.log.gz 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113799.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113707.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113799.log.gz 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mds.c.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.113707.log.gz 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112828.log 2023-11-24T06:15:34.396 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.113481.log 2023-11-24T06:15:34.397 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.112828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114398.log 2023-11-24T06:15:34.397 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112828.log.gz 2023-11-24T06:15:34.397 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.2.113481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118683.log 2023-11-24T06:15:34.397 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.113481.log.gz 2023-11-24T06:15:34.397 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111862.log 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.114398.log.gz 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115098.log 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111862.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.118683.log.gz 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118499.log 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.111862.log.gz 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110909.log 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118499.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115098.log.gz 2023-11-24T06:15:34.398 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117702.log 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.118499.log.gz 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118253.log 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110909.log.gz 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111494.log 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3%/var/log/ceph/ceph-client.admin.118253.log: -- replaced with /var/log/ceph/ceph-client.admin.117702.log.gz 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.118253.log.gz 2023-11-24T06:15:34.399 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111494.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.111494.log.gz 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118545.log 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117265.log 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114960.log 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117265.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118545.log.gz 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.117265.log.gz 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114960.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114960.log.gz 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116389.log 2023-11-24T06:15:34.400 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110919.log 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110538.log 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110919.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116389.log.gz 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.110919.log.gz 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110538.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110538.log.gz 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111284.log 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110206.log 2023-11-24T06:15:34.401 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109359.log 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110206.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111284.log.gz 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.110206.log.gz 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109359.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.109359.log.gz 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114306.log 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113983.log 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119112.log 2023-11-24T06:15:34.402 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113983.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114306.log.gz 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119112.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113983.log.gz 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119112.log.gz 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117564.log 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116979.log 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117564.log.gz 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.116979.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116979.log.gz 2023-11-24T06:15:34.403 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103591.log 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120353.log 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.103591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120399.log 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103591.log.gz/var/log/ceph/ceph-client.admin.120353.log: 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120353.log.gz 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120399.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120399.log.gz 2023-11-24T06:15:34.404 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119342.log 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116887.log 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116159.log 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116887.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119342.log.gz 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116887.log.gz 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120767.log 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.116159.log.gz 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110549.log 2023-11-24T06:15:34.405 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118143.log 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110549.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.120767.log.gz 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.110549.log.gz 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.118143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118143.log.gz 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113753.log 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110344.log 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120951.log 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9%/var/log/ceph/ceph-client.admin.110344.log: -- replaced with /var/log/ceph/ceph-client.admin.113753.log.gz 2023-11-24T06:15:34.406 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.110344.log.gz 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120951.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120951.log.gz 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115929.log 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114214.log 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120721.log 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114214.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115929.log.gz 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.114214.log.gz 2023-11-24T06:15:34.407 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120721.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.120721.log.gz 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117451.log 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115791.log 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114075.log 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118299.log 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.117451.log.gz 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115791.log.gz 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116435.log 2023-11-24T06:15:34.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118299.log: /var/log/ceph/ceph-client.admin.116343.log 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114075.log.gz 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116435.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.118299.log.gz 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116343.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116435.log.gz 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.116343.log.gz 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114465.log 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120813.log 2023-11-24T06:15:34.409 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115324.log 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.114465.log.gz 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119066.log 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117910.log 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115324.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120813.log.gz 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117497.log 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115324.log.gz 2023-11-24T06:15:34.410 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117910.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119066.log.gz 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.117910.log.gz 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117497.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117497.log.gz 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114603.log 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121204.log 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119664.log 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121204.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.114603.log.gz 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121204.log.gz 2023-11-24T06:15:34.411 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119664.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119664.log.gz 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.118147.log 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121043.log 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.118147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119618.log 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.118147.log.gz 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109583.log 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119618.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.121043.log.gz 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109583.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119618.log.gz 2023-11-24T06:15:34.412 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116067.log 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.109583.log.gz 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114557.log 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116067.log: /var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110537.log 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.116067.log.gz 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110160.log 2023-11-24T06:15:34.413 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110537.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.114557.log.gz 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110537.log.gz 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110160.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110160.log.gz 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114122.log 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111770.log 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117025.log 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111770.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.114122.log.gz 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111540.log 2023-11-24T06:15:34.414 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.111770.log.gz 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116663.log 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111540.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117025.log.gz 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116663.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111540.log.gz 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.116663.log.gz 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115565.log 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109721.log 2023-11-24T06:15:34.415 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115565.log: /var/log/ceph/ceph-client.admin.109721.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.115565.log.gz 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.109721.log.gz 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117217.log 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111280.log 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117217.log: /var/log/ceph/ceph-client.admin.111280.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.117217.log.gz 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109976.log 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.111280.log.gz 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120905.log 2023-11-24T06:15:34.416 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109976.log: /var/log/ceph/ceph-client.admin.120905.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.109976.log.gz 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.120905.log.gz 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110551.log 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119434.log 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114649.log 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119434.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.110551.log.gz 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.119434.log.gz 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114649.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114649.log.gz 2023-11-24T06:15:34.417 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109838.log 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119296.log 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115975.log 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119296.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.109838.log.gz 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.119296.log.gz 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115975.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.115975.log.gz 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116527.log 2023-11-24T06:15:34.418 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112000.log 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116527.log: /var/log/ceph/ceph-client.admin.112000.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.116527.log.gz 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.112000.log.gz 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109537.log 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111816.log 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.109537.log: /var/log/ceph/ceph-client.admin.111816.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.109537.log.gz 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.111816.log.gz 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118909.log 2023-11-24T06:15:34.419 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118637.log 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118909.log: /var/log/ceph/ceph-client.admin.118637.log: gzip 89.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.118909.log.gz-- 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118817.log 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.118637.log.gz 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109250.log 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.118817.log: /var/log/ceph/ceph-client.admin.109250.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.118817.log.gz 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.109250.log.gz 2023-11-24T06:15:34.420 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110910.log 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110544.log 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117117.log 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110544.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.110910.log.gz 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117117.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.110544.log.gz 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.117117.log.gz 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119526.log 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119388.log 2023-11-24T06:15:34.421 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119526.log: /var/log/ceph/ceph-client.admin.119388.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.119526.log.gz 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119388.log.gz 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116747.log 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120445.log 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111908.log 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120445.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116747.log.gz 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111908.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120445.log.gz 2023-11-24T06:15:34.422 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111908.log.gz 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111287.log 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120261.log 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111287.log: /var/log/ceph/ceph-client.admin.120261.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.111287.log.gz 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120261.log.gz 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115883.log 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103722.log 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116251.log 2023-11-24T06:15:34.423 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.103722.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115883.log.gz 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116251.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103722.log.gz 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.116251.log.gz 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119480.log 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109930.log 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119480.log: /var/log/ceph/ceph-client.admin.109930.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.119480.log.gz 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.109930.log.gz 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120629.log 2023-11-24T06:15:34.424 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120307.log 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120629.log: /var/log/ceph/ceph-client.admin.120307.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.120629.log.gz 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115278.log 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120307.log.gz 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118771.log 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.115278.log: /var/log/ceph/ceph-client.admin.118771.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.115278.log.gz 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.118771.log.gz 2023-11-24T06:15:34.425 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110914.log 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120491.log 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111954.log 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120491.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110914.log.gz 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.111954.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.120491.log.gz 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.111954.log.gz 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120675.log 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116113.log 2023-11-24T06:15:34.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.120675.log: /var/log/ceph/ceph-client.admin.116113.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120675.log.gz 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.116113.log.gz 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112046.log 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119020.log 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.112046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114787.log 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119020.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.112046.log.gz 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-11-24T06:15:34.427 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.114787.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.119020.log.gz 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114787.log.gz 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117656.log 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117748.log 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.117656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.112820.log 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.117656.log.gz/var/log/ceph/ceph-client.admin.117748.log: 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113891.log 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.0.112820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.117748.log.gz 2023-11-24T06:15:34.428 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.112820.log.gz 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111276.log 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113891.log: /var/log/ceph/ceph-client.admin.111276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119848.log 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.113891.log.gz 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.111276.log.gz 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116839.log 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.119848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121089.log 2023-11-24T06:15:34.429 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.116839.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.119848.log.gz 2023-11-24T06:15:34.430 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.116839.log.gz 2023-11-24T06:15:34.430 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.121089.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121089.log.gz 2023-11-24T06:15:34.430 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-11-24T06:15:34.430 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114695.log 2023-11-24T06:15:34.432 INFO:teuthology.orchestra.run.smithi176.stderr: 95.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-11-24T06:15:34.432 INFO:teuthology.orchestra.run.smithi176.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-11-24T06:15:34.432 INFO:teuthology.orchestra.run.smithi176.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-11-24T06:15:34.432 INFO:teuthology.orchestra.run.smithi176.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-11-24T06:15:34.432 INFO:teuthology.orchestra.run.smithi176.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-11-24T06:15:34.433 INFO:teuthology.orchestra.run.smithi176.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.114695.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.114695.log.gz 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113050.log 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114352.log 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.113050.log: /var/log/ceph/ceph-client.admin.114352.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.113050.log.gz 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.114352.log.gz 2023-11-24T06:15:34.434 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110252.log 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117405.log 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.110252.log: /var/log/ceph/ceph-client.admin.117405.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.110252.log.gz 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.117405.log.gz 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-11-24T06:15:34.435 INFO:teuthology.orchestra.run.smithi106.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-11-24T06:15:34.459 INFO:teuthology.orchestra.run.smithi176.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-11-24T06:15:34.460 INFO:teuthology.orchestra.run.smithi176.stderr: 2023-11-24T06:15:34.461 INFO:teuthology.orchestra.run.smithi176.stderr:real 0m0.167s 2023-11-24T06:15:34.461 INFO:teuthology.orchestra.run.smithi176.stderr:user 0m0.712s 2023-11-24T06:15:34.461 INFO:teuthology.orchestra.run.smithi176.stderr:sys 0m0.047s 2023-11-24T06:15:34.516 INFO:teuthology.orchestra.run.smithi106.stderr: 91.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-11-24T06:15:34.518 INFO:teuthology.orchestra.run.smithi106.stderr: 2023-11-24T06:15:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m0.268s 2023-11-24T06:15:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m0.655s 2023-11-24T06:15:34.518 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.156s 2023-11-24T06:15:34.519 INFO:tasks.ceph:Archiving logs... 2023-11-24T06:15:34.519 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi106/log 2023-11-24T06:15:34.520 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:15:34.850 DEBUG:teuthology.misc:Transferring archived files from smithi176:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi176/log 2023-11-24T06:15:34.851 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /var/log/ceph -- . 2023-11-24T06:15:34.983 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-11-24T06:15:35.007 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-11-24T06:15:35.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:15:35.010 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-11-24T06:15:35.083 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-11-24T06:15:35.094 INFO:teuthology.task.clock:Checking final clock skew... 2023-11-24T06:15:35.094 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:15:35.096 DEBUG:teuthology.orchestra.run.smithi176:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-24T06:15:35.109 INFO:teuthology.orchestra.run.smithi106.stderr:bash: ntpq: command not found 2023-11-24T06:15:35.111 INFO:teuthology.orchestra.run.smithi176.stderr:bash: ntpq: command not found 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:=============================================================================== 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 52 +2129us[+2126us] +/- 71ms 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:^* hv02.front.sepia.ceph.com 3 6 377 50 -1682us[-1684us] +/- 59ms 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -130us[ -132us] +/- 91ms 2023-11-24T06:15:35.114 INFO:teuthology.orchestra.run.smithi106.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:15:35.115 INFO:teuthology.orchestra.run.smithi176.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-11-24T06:15:35.115 INFO:teuthology.orchestra.run.smithi176.stdout:=============================================================================== 2023-11-24T06:15:35.115 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv01.front.sepia.ceph.com 3 6 377 52 +2141us[+2144us] +/- 71ms 2023-11-24T06:15:35.115 INFO:teuthology.orchestra.run.smithi176.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 -1671us[-1668us] +/- 59ms 2023-11-24T06:15:35.116 INFO:teuthology.orchestra.run.smithi176.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -132us[ -130us] +/- 91ms 2023-11-24T06:15:35.116 INFO:teuthology.orchestra.run.smithi176.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-11-24T06:15:35.116 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-11-24T06:15:35.127 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-11-24T06:15:35.127 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-11-24T06:15:35.137 DEBUG:teuthology.orchestra.run.smithi106:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:15:35.249 DEBUG:teuthology.orchestra.run.smithi176:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-11-24T06:15:35.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:15:35.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:35.375 DEBUG:teuthology.orchestra.run.smithi176:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-11-24T06:15:35.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:35.407 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-11-24T06:15:35.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-11-24T06:15:35.432 INFO:teuthology.task.internal:Duration was 841.038210 seconds 2023-11-24T06:15:35.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-11-24T06:15:35.443 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-11-24T06:15:35.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:15:35.448 DEBUG:teuthology.orchestra.run.smithi176:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-11-24T06:15:35.493 INFO:teuthology.orchestra.run.smithi106.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:15:35.494 INFO:teuthology.orchestra.run.smithi176.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-11-24T06:15:35.692 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-11-24T06:15:35.692 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2023-11-24T06:15:35.693 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:15:35.714 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi176.front.sepia.ceph.com 2023-11-24T06:15:35.714 DEBUG:teuthology.orchestra.run.smithi176:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-11-24T06:15:35.735 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-11-24T06:15:35.736 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:15:35.757 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-11-24T06:15:35.816 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-11-24T06:15:35.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:15:35.838 DEBUG:teuthology.orchestra.run.smithi176:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-11-24T06:15:35.932 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-11-24T06:15:35.944 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-11-24T06:15:35.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:15:35.971 DEBUG:teuthology.orchestra.run.smithi176:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-11-24T06:15:35.997 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-11-24T06:15:36.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:15:36.014 DEBUG:teuthology.orchestra.run.smithi176:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:15:36.037 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2023-11-24T06:15:36.063 INFO:teuthology.orchestra.run.smithi176.stdout:kernel.core_pattern = core 2023-11-24T06:15:36.077 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:15:36.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:36.109 DEBUG:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump 2023-11-24T06:15:36.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-24T06:15:36.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-11-24T06:15:36.144 INFO:teuthology.task.internal:Transferring archived files... 2023-11-24T06:15:36.145 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi106 2023-11-24T06:15:36.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:15:36.186 DEBUG:teuthology.misc:Transferring archived files from smithi176:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553/remote/smithi176 2023-11-24T06:15:36.187 DEBUG:teuthology.orchestra.run.smithi176:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-11-24T06:15:36.223 INFO:teuthology.task.internal:Removing archive directory... 2023-11-24T06:15:36.223 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:15:36.225 DEBUG:teuthology.orchestra.run.smithi176:> rm -rf -- /home/ubuntu/cephtest/archive 2023-11-24T06:15:36.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-11-24T06:15:36.285 INFO:teuthology.task.internal:Not uploading archives. 2023-11-24T06:15:36.286 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-11-24T06:15:36.299 INFO:teuthology.task.internal:Tidying up after the test... 2023-11-24T06:15:36.299 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:15:36.302 DEBUG:teuthology.orchestra.run.smithi176:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-11-24T06:15:36.316 INFO:teuthology.orchestra.run.smithi106.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:15 /home/ubuntu/cephtest 2023-11-24T06:15:36.329 INFO:teuthology.orchestra.run.smithi176.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Nov 24 06:15 /home/ubuntu/cephtest 2023-11-24T06:15:36.331 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-11-24T06:15:36.344 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-11-24T06:15:36.375 INFO:teuthology.nuke:Checking targets against current locks 2023-11-24T06:15:36.398 DEBUG:teuthology.nuke:shortname: smithi106 2023-11-24T06:15:36.399 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:15:36.422 DEBUG:teuthology.nuke:shortname: smithi176 2023-11-24T06:15:36.422 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-24T06:15:36.427 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:56:09.150531', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T06:15:36.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi176.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-11-24_05:41:33-fs:volumes-rishabh-mgr-vol-misc-testing-default-smithi/7465553', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-24 05:56:09.148649', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-11-24T06:15:36.491 INFO:teuthology.orchestra.console.smithi176:Power off 2023-11-24T06:15:36.492 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:15:36.515 DEBUG:teuthology.orchestra.console.smithi176:power off output: Chassis Power Control: Down/Off 2023-11-24T06:15:36.516 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:36.533 INFO:teuthology.orchestra.console.smithi106:Power off 2023-11-24T06:15:36.533 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-11-24T06:15:36.544 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-24T06:15:36.556 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2023-11-24T06:15:36.556 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:36.581 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2023-11-24T06:15:40.545 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:40.582 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:40.656 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-24T06:15:40.694 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2023-11-24T06:15:44.658 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:44.694 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:44.768 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is on 2023-11-24T06:15:44.804 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2023-11-24T06:15:48.773 DEBUG:teuthology.orchestra.console.smithi176:pexpect command: ipmitool -H smithi176.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:48.805 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-11-24T06:15:48.883 DEBUG:teuthology.orchestra.console.smithi176:check power output: Chassis Power is off 2023-11-24T06:15:48.915 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2023-11-24T06:15:48.985 INFO:teuthology.orchestra.console.smithi176:Power off completed 2023-11-24T06:15:49.016 INFO:teuthology.orchestra.console.smithi106:Power off completed 2023-11-24T06:15:49.121 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} duration: 841.0382101535797 failure_reason: 'Test failure: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread)' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8dd49751c9c047cda0097cd38b168586 status: fail success: false 2023-11-24T06:15:49.121 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-24T06:15:49.204 INFO:teuthology.run:FAIL